Analyze content for safety ratings

Many a times, you need to check a profile or piece of content for ratings related to risky categories of content that may violate platform guidelines, may hurt user sentiments or may go against brand identity. InsightIQ's brand safety APIs help you get these ratings with minimum friction.

Our APIs connect with AI based media screening systems and fetch you ratings for a certain set of pre-defined categories and subcategories of safety violations (details of these can be found on this Airtable). You can get granular analysis for each piece of content, and even get access to the raw data on risk ratings in case you want to build your own thresholds and safety algorithms.

Here's how it works.

Steps to get risk score for a image or video URL

First, you need to create a request for media analysis by providing the media_url along with a media_type (IMAGE or VIDEO) and optionally the caption or any other associated text, using the submit request to get risk score for a media URL endpoint. You will get a unique media risk score analysis ID in return.

When the risk analysis is complete, InsightIQ triggers the SAFETY_FETCH.SUCCESS webhook. Make sure to read about our webhooks and setup your webhooks correctly.

Then, using the job_id from the webhook, call the get the risk score for a media URL. This gives you the risk report for the submitted media.

Steps to get risk score for a content/post on a work platform

First, you need to create a request for content analysis by providing the content_url along with the work_platform_id (we currently support Instagram, LinkedIn, Twitter, Facebook, and TikTok), using the submit request to get risk score for a content item endpoint. You will get a unique content risk score analysis ID in return.

When the risk analysis is complete, InsightIQ triggers the SAFETY_FETCH.SUCCESS webhook. Make sure to read about our webhooks and setup your webhooks correctly.

Then, using the job_id from the webhook, call the get the risk score for a content item. This gives you the risk report for the submitted content.

Steps to get risk score for a profile on a work platform

First, you need to create a request for profile analysis by providing the profile_url along with the work_platform_id (we currently support Instagram, LinkedIn, Twitter, Facebook, and TikTok), and either the number of content_items or a date range (from_date and to_date), using the submit request to get risk score for a profile endpoint. Specifying the content_items will mean that the API only analyzes the latest number of content items equal to the value of that param, whereas adding a date range will mean that all the content posted between those dates will be analyzed to generate the risk score and safety ratings. You will get a unique profile risk score analysis ID in return.

When the risk analysis is complete, InsightIQ triggers the SAFETY_FETCH.SUCCESS webhook. Make sure to read about our webhooks and setup your webhooks correctly.

Then, using the job_id from the webhook, call the get the risk score for a profile. This gives you the risk report for the submitted profile.

You can also get the entire list of contents that were analysed, optionally along with the detailed raw risk scores across categories, using the get the risk score for a content item from profile API endpoint.

Talk to us

We are dedicated to building a safe and healthy environment for creators and consumers alike, based on their preferences. Tell us at [email protected] if you find this API useful and if you have any further ideas to make the internet better for everyone.