Text Analytics API (v2.1)

The Text Analytics API is a suite of text analytics web services built with best-in-class Microsoft machine learning algorithms. The API can be used to analyze unstructured text for tasks such as sentiment analysis, key phrase and entity extraction as well as language detection. No training data is needed to use this API; just bring your text data. This API uses advanced natural language processing techniques to deliver best in class predictions.

Further documentation can be found in https://docs.microsoft.com/en-us/azure/cognitive-services/text-analytics/overview

This API is currently available in:

  • Australia East - australiaeast.api.cognitive.microsoft.com
  • Brazil South - brazilsouth.api.cognitive.microsoft.com
  • Canada Central - canadacentral.api.cognitive.microsoft.com
  • Central India - centralindia.api.cognitive.microsoft.com
  • Central US - centralus.api.cognitive.microsoft.com
  • East Asia - eastasia.api.cognitive.microsoft.com
  • East US - eastus.api.cognitive.microsoft.com
  • East US 2 - eastus2.api.cognitive.microsoft.com
  • France Central - francecentral.api.cognitive.microsoft.com
  • Japan East - japaneast.api.cognitive.microsoft.com
  • Japan West - japanwest.api.cognitive.microsoft.com
  • Korea Central - koreacentral.api.cognitive.microsoft.com
  • North Central US - northcentralus.api.cognitive.microsoft.com
  • North Europe - northeurope.api.cognitive.microsoft.com
  • South Africa North - southafricanorth.api.cognitive.microsoft.com
  • South Central US - southcentralus.api.cognitive.microsoft.com
  • Southeast Asia - southeastasia.api.cognitive.microsoft.com
  • UK South - uksouth.api.cognitive.microsoft.com
  • West Central US - westcentralus.api.cognitive.microsoft.com
  • West Europe - westeurope.api.cognitive.microsoft.com
  • West US - westus.api.cognitive.microsoft.com
  • West US 2 - westus2.api.cognitive.microsoft.com

Detect Language

The API returns the detected language and a numeric score between 0 and 1. Scores close to 1 indicate 100% certainty that the identified language is true. A total of 120 languages are supported.

Select the testing console in the region where you created your resource:

West US West US 2 East US East US 2 West Central US South Central US West Europe North Europe Southeast Asia East Asia Australia East Brazil South Canada Central UK South Japan East Central US France Central Korea Central Japan West North Central US South Africa North UAE North Switzerland North Switzerland West Central India West US 3 Norway East Jio India West

Request URL

Request parameters

(optional)
boolean

(optional) if set to true, response will contain input and document level statistics.

Request headers

string
Media type of the body sent to the API.
string
Subscription key which provides access to this API. Found in your Cognitive Services accounts.

Request body

Collection of documents to analyze.

{
  "documents": [
    {
      "countryHint": "US",
      "id": "1",
      "text": "Hello world"
    },
    {
      "countryHint": "US",
      "id": "2",
      "text": "Bonjour tout le monde"
    },
    {
      "countryHint": "US",
      "id": "3",
      "text": "La carretera estaba atascada. Había mucho tráfico el día de ayer."
    },
    {
      "countryHint": "US",
      "id": "4",
      "text": ":) :( :D"
    }
  ]
}
{
  "type": "object",
  "properties": {
    "documents": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "countryHint": {
            "type": "string"
          },
          "id": {
            "description": "Unique, non-empty document identifier.",
            "type": "string"
          },
          "text": {
            "type": "string"
          }
        }
      }
    }
  },
  "example": {
    "documents": [
      {
        "countryHint": "US",
        "id": "1",
        "text": "Hello world"
      },
      {
        "countryHint": "US",
        "id": "2",
        "text": "Bonjour tout le monde"
      },
      {
        "countryHint": "US",
        "id": "3",
        "text": "La carretera estaba atascada. Había mucho tráfico el día de ayer."
      },
      {
        "countryHint": "US",
        "id": "4",
        "text": ":) :( :D"
      }
    ]
  }
}
{
  "documents": [
    {
      "countryHint": "US",
      "id": "1",
      "text": "Hello world"
    },
    {
      "countryHint": "US",
      "id": "2",
      "text": "Bonjour tout le monde"
    },
    {
      "countryHint": "US",
      "id": "3",
      "text": "La carretera estaba atascada. Había mucho tráfico el día de ayer."
    },
    {
      "countryHint": "US",
      "id": "4",
      "text": ":) :( :D"
    }
  ]
}
{
  "type": "object",
  "properties": {
    "documents": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "countryHint": {
            "type": "string"
          },
          "id": {
            "description": "Unique, non-empty document identifier.",
            "type": "string"
          },
          "text": {
            "type": "string"
          }
        }
      }
    }
  },
  "example": {
    "documents": [
      {
        "countryHint": "US",
        "id": "1",
        "text": "Hello world"
      },
      {
        "countryHint": "US",
        "id": "2",
        "text": "Bonjour tout le monde"
      },
      {
        "countryHint": "US",
        "id": "3",
        "text": "La carretera estaba atascada. Había mucho tráfico el día de ayer."
      },
      {
        "countryHint": "US",
        "id": "4",
        "text": ":) :( :D"
      }
    ]
  }
}

Response 200

A successful call results in the detected language with the highest probability for each valid document

{
  "documents": [
    {
      "id": "1",
      "detectedLanguages": [
        {
          "name": "English",
          "iso6391Name": "en",
          "score": 1
        }
      ]
    },
    {
      "id": "2",
      "detectedLanguages": [
        {
          "name": "French",
          "iso6391Name": "fr",
          "score": 1
        }
      ]
    },
    {
      "id": "3",
      "detectedLanguages": [
        {
          "name": "Spanish",
          "iso6391Name": "es",
          "score": 1
        }
      ]
    },
    {
      "id": "4",
      "detectedLanguages": [
        {
          "name": "(Unknown)",
          "iso6391Name": "(Unknown)",
          "score": 0
        }
      ]
    }
  ],
  "errors": []
}
{
  "type": "object",
  "properties": {
    "documents": {
      "description": "Response by document",
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "id": {
            "description": "Unique, non-empty document identifier.",
            "type": "string"
          },
          "detectedLanguages": {
            "description": "A list of extracted languages.",
            "type": "array",
            "items": {
              "type": "object",
              "properties": {
                "name": {
                  "description": "Long name of a detected language (e.g. English, French).",
                  "type": "string"
                },
                "iso6391Name": {
                  "description": "A two letter representation of the detected language according to the ISO 639-1 standard (e.g. en, fr).",
                  "type": "string"
                },
                "score": {
                  "format": "double",
                  "description": "A confidence score between 0 and 1. Scores close to 1 indicate 100% certainty that the identified language is true.",
                  "type": "number"
                }
              }
            }
          },
          "statistics": {
            "type": "object",
            "properties": {
              "charactersCount": {
                "format": "int32",
                "description": "Number of text elements recognized in the document.",
                "type": "integer"
              },
              "transactionsCount": {
                "format": "int32",
                "description": "Number of transactions for the document.",
                "type": "integer"
              }
            },
            "description": "(Optional) if showStats=true was specified in the request this field will contain information about the \r\n            document payload."
          }
        }
      },
      "readOnly": true
    },
    "errors": {
      "description": "Errors and Warnings by document",
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "id": {
            "description": "Input document unique identifier the error refers to.",
            "type": "string"
          },
          "message": {
            "description": "Error message.",
            "type": "string"
          }
        }
      },
      "readOnly": true
    },
    "statistics": {
      "type": "object",
      "properties": {
        "documentsCount": {
          "format": "int32",
          "description": "Number of documents submitted in the request.",
          "type": "integer"
        },
        "validDocumentsCount": {
          "format": "int32",
          "description": "Number of valid documents. This excludes empty, over-size limit or non-supported languages documents.",
          "type": "integer"
        },
        "erroneousDocumentsCount": {
          "format": "int32",
          "description": "Number of invalid documents. This includes empty, over-size limit or non-supported languages documents.",
          "type": "integer"
        },
        "transactionsCount": {
          "format": "int64",
          "description": "Number of transactions for the request.",
          "type": "integer"
        }
      },
      "description": "/// <summary>\r\n            (Optional) if showStats=true was specified in the request this field will contain information about the \r\n            request payload.\r\n            </summary>",
      "readOnly": true
    }
  }
}
{
  "documents": [
    {
      "id": "string",
      "detectedLanguages": [
        {
          "name": "string",
          "iso6391Name": "string",
          "score": 0.0
        }
      ],
      "statistics": {
        "charactersCount": 0,
        "transactionsCount": 0
      }
    }
  ],
  "errors": [
    {
      "id": "string",
      "message": "string"
    }
  ],
  "statistics": {
    "documentsCount": 0,
    "validDocumentsCount": 0,
    "erroneousDocumentsCount": 0,
    "transactionsCount": 0
  }
}
{
  "type": "object",
  "properties": {
    "documents": {
      "description": "Response by document",
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "id": {
            "description": "Unique, non-empty document identifier.",
            "type": "string"
          },
          "detectedLanguages": {
            "description": "A list of extracted languages.",
            "type": "array",
            "items": {
              "type": "object",
              "properties": {
                "name": {
                  "description": "Long name of a detected language (e.g. English, French).",
                  "type": "string"
                },
                "iso6391Name": {
                  "description": "A two letter representation of the detected language according to the ISO 639-1 standard (e.g. en, fr).",
                  "type": "string"
                },
                "score": {
                  "format": "double",
                  "description": "A confidence score between 0 and 1. Scores close to 1 indicate 100% certainty that the identified language is true.",
                  "type": "number"
                }
              }
            }
          },
          "statistics": {
            "type": "object",
            "properties": {
              "charactersCount": {
                "format": "int32",
                "description": "Number of text elements recognized in the document.",
                "type": "integer"
              },
              "transactionsCount": {
                "format": "int32",
                "description": "Number of transactions for the document.",
                "type": "integer"
              }
            },
            "description": "(Optional) if showStats=true was specified in the request this field will contain information about the \r\n            document payload."
          }
        }
      },
      "readOnly": true
    },
    "errors": {
      "description": "Errors and Warnings by document",
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "id": {
            "description": "Input document unique identifier the error refers to.",
            "type": "string"
          },
          "message": {
            "description": "Error message.",
            "type": "string"
          }
        }
      },
      "readOnly": true
    },
    "statistics": {
      "type": "object",
      "properties": {
        "documentsCount": {
          "format": "int32",
          "description": "Number of documents submitted in the request.",
          "type": "integer"
        },
        "validDocumentsCount": {
          "format": "int32",
          "description": "Number of valid documents. This excludes empty, over-size limit or non-supported languages documents.",
          "type": "integer"
        },
        "erroneousDocumentsCount": {
          "format": "int32",
          "description": "Number of invalid documents. This includes empty, over-size limit or non-supported languages documents.",
          "type": "integer"
        },
        "transactionsCount": {
          "format": "int64",
          "description": "Number of transactions for the request.",
          "type": "integer"
        }
      },
      "description": "/// <summary>\r\n            (Optional) if showStats=true was specified in the request this field will contain information about the \r\n            request payload.\r\n            </summary>",
      "readOnly": true
    }
  }
}

Response 500

Code samples

@ECHO OFF

curl -v -X POST "https://westus.api.cognitive.microsoft.com/text/analytics/v2.1/languages?showStats={boolean}"
-H "Content-Type: application/json"
-H "Ocp-Apim-Subscription-Key: {subscription key}"

--data-ascii "{body}" 
using System;
using System.Net.Http.Headers;
using System.Text;
using System.Net.Http;
using System.Web;

namespace CSHttpClientSample
{
    static class Program
    {
        static void Main()
        {
            MakeRequest();
            Console.WriteLine("Hit ENTER to exit...");
            Console.ReadLine();
        }
        
        static async void MakeRequest()
        {
            var client = new HttpClient();
            var queryString = HttpUtility.ParseQueryString(string.Empty);

            // Request headers
            client.DefaultRequestHeaders.Add("Ocp-Apim-Subscription-Key", "{subscription key}");

            // Request parameters
            queryString["showStats"] = "{boolean}";
            var uri = "https://westus.api.cognitive.microsoft.com/text/analytics/v2.1/languages?" + queryString;

            HttpResponseMessage response;

            // Request body
            byte[] byteData = Encoding.UTF8.GetBytes("{body}");

            using (var content = new ByteArrayContent(byteData))
            {
               content.Headers.ContentType = new MediaTypeHeaderValue("< your content type, i.e. application/json >");
               response = await client.PostAsync(uri, content);
            }

        }
    }
}	
// // This sample uses the Apache HTTP client from HTTP Components (http://hc.apache.org/httpcomponents-client-ga/)
import java.net.URI;
import org.apache.http.HttpEntity;
import org.apache.http.HttpResponse;
import org.apache.http.client.HttpClient;
import org.apache.http.client.methods.HttpGet;
import org.apache.http.client.utils.URIBuilder;
import org.apache.http.impl.client.HttpClients;
import org.apache.http.util.EntityUtils;

public class JavaSample 
{
    public static void main(String[] args) 
    {
        HttpClient httpclient = HttpClients.createDefault();

        try
        {
            URIBuilder builder = new URIBuilder("https://westus.api.cognitive.microsoft.com/text/analytics/v2.1/languages");

            builder.setParameter("showStats", "{boolean}");

            URI uri = builder.build();
            HttpPost request = new HttpPost(uri);
            request.setHeader("Content-Type", "application/json");
            request.setHeader("Ocp-Apim-Subscription-Key", "{subscription key}");


            // Request body
            StringEntity reqEntity = new StringEntity("{body}");
            request.setEntity(reqEntity);

            HttpResponse response = httpclient.execute(request);
            HttpEntity entity = response.getEntity();

            if (entity != null) 
            {
                System.out.println(EntityUtils.toString(entity));
            }
        }
        catch (Exception e)
        {
            System.out.println(e.getMessage());
        }
    }
}

<!DOCTYPE html>
<html>
<head>
    <title>JSSample</title>
    <script src="http://ajax.googleapis.com/ajax/libs/jquery/1.9.0/jquery.min.js"></script>
</head>
<body>

<script type="text/javascript">
    $(function() {
        var params = {
            // Request parameters
            "showStats": "{boolean}",
        };
      
        $.ajax({
            url: "https://westus.api.cognitive.microsoft.com/text/analytics/v2.1/languages?" + $.param(params),
            beforeSend: function(xhrObj){
                // Request headers
                xhrObj.setRequestHeader("Content-Type","application/json");
                xhrObj.setRequestHeader("Ocp-Apim-Subscription-Key","{subscription key}");
            },
            type: "POST",
            // Request body
            data: "{body}",
        })
        .done(function(data) {
            alert("success");
        })
        .fail(function() {
            alert("error");
        });
    });
</script>
</body>
</html>
#import <Foundation/Foundation.h>

int main(int argc, const char * argv[])
{
    NSAutoreleasePool * pool = [[NSAutoreleasePool alloc] init];
    
    NSString* path = @"https://westus.api.cognitive.microsoft.com/text/analytics/v2.1/languages";
    NSArray* array = @[
                         // Request parameters
                         @"entities=true",
                         @"showStats={boolean}",
                      ];
    
    NSString* string = [array componentsJoinedByString:@"&"];
    path = [path stringByAppendingFormat:@"?%@", string];

    NSLog(@"%@", path);

    NSMutableURLRequest* _request = [NSMutableURLRequest requestWithURL:[NSURL URLWithString:path]];
    [_request setHTTPMethod:@"POST"];
    // Request headers
    [_request setValue:@"application/json" forHTTPHeaderField:@"Content-Type"];
    [_request setValue:@"{subscription key}" forHTTPHeaderField:@"Ocp-Apim-Subscription-Key"];
    // Request body
    [_request setHTTPBody:[@"{body}" dataUsingEncoding:NSUTF8StringEncoding]];
    
    NSURLResponse *response = nil;
    NSError *error = nil;
    NSData* _connectionData = [NSURLConnection sendSynchronousRequest:_request returningResponse:&response error:&error];

    if (nil != error)
    {
        NSLog(@"Error: %@", error);
    }
    else
    {
        NSError* error = nil;
        NSMutableDictionary* json = nil;
        NSString* dataString = [[NSString alloc] initWithData:_connectionData encoding:NSUTF8StringEncoding];
        NSLog(@"%@", dataString);
        
        if (nil != _connectionData)
        {
            json = [NSJSONSerialization JSONObjectWithData:_connectionData options:NSJSONReadingMutableContainers error:&error];
        }
        
        if (error || !json)
        {
            NSLog(@"Could not parse loaded json with error:%@", error);
        }
        
        NSLog(@"%@", json);
        _connectionData = nil;
    }
    
    [pool drain];

    return 0;
}
<?php
// This sample uses the Apache HTTP client from HTTP Components (http://hc.apache.org/httpcomponents-client-ga/)
require_once 'HTTP/Request2.php';

$request = new Http_Request2('https://westus.api.cognitive.microsoft.com/text/analytics/v2.1/languages');
$url = $request->getUrl();

$headers = array(
    // Request headers
    'Content-Type' => 'application/json',
    'Ocp-Apim-Subscription-Key' => '{subscription key}',
);

$request->setHeader($headers);

$parameters = array(
    // Request parameters
    'showStats' => '{boolean}',
);

$url->setQueryVariables($parameters);

$request->setMethod(HTTP_Request2::METHOD_POST);

// Request body
$request->setBody("{body}");

try
{
    $response = $request->send();
    echo $response->getBody();
}
catch (HttpException $ex)
{
    echo $ex;
}

?>
########### Python 2.7 #############
import httplib, urllib, base64

headers = {
    # Request headers
    'Content-Type': 'application/json',
    'Ocp-Apim-Subscription-Key': '{subscription key}',
}

params = urllib.urlencode({
    # Request parameters
    'showStats': '{boolean}',
})

try:
    conn = httplib.HTTPSConnection('westus.api.cognitive.microsoft.com')
    conn.request("POST", "/text/analytics/v2.1/languages?%s" % params, "{body}", headers)
    response = conn.getresponse()
    data = response.read()
    print(data)
    conn.close()
except Exception as e:
    print("[Errno {0}] {1}".format(e.errno, e.strerror))

####################################

########### Python 3.2 #############
import http.client, urllib.request, urllib.parse, urllib.error, base64

headers = {
    # Request headers
    'Content-Type': 'application/json',
    'Ocp-Apim-Subscription-Key': '{subscription key}',
}

params = urllib.parse.urlencode({
    # Request parameters
    'showStats': '{boolean}',
})

try:
    conn = http.client.HTTPSConnection('westus.api.cognitive.microsoft.com')
    conn.request("POST", "/text/analytics/v2.1/languages?%s" % params, "{body}", headers)
    response = conn.getresponse()
    data = response.read()
    print(data)
    conn.close()
except Exception as e:
    print("[Errno {0}] {1}".format(e.errno, e.strerror))

####################################
require 'net/http'

uri = URI('https://westus.api.cognitive.microsoft.com/text/analytics/v2.1/languages')
uri.query = URI.encode_www_form({
    # Request parameters
    'showStats' => '{boolean}'
})

request = Net::HTTP::Post.new(uri.request_uri)
# Request headers
request['Content-Type'] = 'application/json'
# Request headers
request['Ocp-Apim-Subscription-Key'] = '{subscription key}'
# Request body
request.body = "{body}"

response = Net::HTTP.start(uri.host, uri.port, :use_ssl => uri.scheme == 'https') do |http|
    http.request(request)
end

puts response.body