URL Categorization Database API
The URL Categorization Database API provides programmatic access to our comprehensive database of 25+ million domains with rich categorization and intelligence data.
Our REST API allows you to query domain information in real-time, including IAB Content Taxonomy categories, Web Filtering categories, company firmographics, technology stacks, popularity metrics, and more. Perfect for AdTech platforms, cybersecurity solutions, content filtering systems, and market research applications.
Authentication
API Base URL: https://www.urlcategorizationdatabase.com/api/
A valid API key is required to access our endpoints. API keys are available with any of our subscription plans. After subscribing, log in to your account to retrieve your API key.
Include your API key in all requests as a parameter:
api_key: your_api_key_here
Successful responses return HTTP status 200 with JSON-formatted data. All API responses include your remaining credit balance for usage tracking.
Rate Limits & Credits
Each API response includes your total_credits
and remaining_credits
. Monitor your usage to avoid service interruption.
When credits are exhausted, upgrade your plan or purchase additional credits from our pricing page. Rate limits vary by plan tier.
Domain Lookup
Retrieve comprehensive information about any domain using our real-time lookup endpoint. Send a GET or POST request with the domain name to receive categorization, company data, technology stack, and more.
Primary Endpoint
GET/POST https://www.urlcategorizationdatabase.com/api/lookup
Available Data Fields
Our API returns rich data for each domain. Request specific fields using the fields
parameter, or omit to receive all available data:
- IAB Categories - Primary and secondary IAB Content Taxonomy classifications
- Web Filter Categories - Multi-level content filtering taxonomies
- Company Data - Business name, industry, employee count, revenue, location
- Technology Stack - 3000+ tracked web technologies and platforms
- Popularity Metrics - OpenPageRank, traffic estimates, domain authority
- Domain Metadata - Registration date, country, TLD information
- User Demographics - Inferred audience personas and demographics
- Risk Scoring - Threat intelligence and safety ratings
Curl Example Request
Replaceyour_api_key
with your actual API key:curl -X POST -H 'Content-Type: application/x-www-form-urlencoded' -d 'domain=example.com&fields=iab_categories,company,technologies&api_key=your_api_key' 'https://www.urlcategorizationdatabase.com/api/lookup'
Request Parameters
Parameter | Type | Description |
---|---|---|
domain | string | The domain name to lookup (e.g., "example.com" or "https://www.example.com") |
fields | string | (Optional) Comma-separated list of data fields to return. Omit for all available data. |
format | string | (Optional) Response format: "json" (default) or "xml" |
api_key | string | Your personal API key from your account dashboard |
Sample API Response
The above command returns a JSON response like this:
{
"domain": "example.com",
"status": 200,
"data": {
"iab_categories": {
"primary": "Technology > Computing",
"secondary": ["Business > B2B", "Education > Online Learning"]
},
"web_filter_categories": ["Business", "Technology"],
"company": {
"name": "Example Corporation",
"industry": "Technology",
"employees": "1001-5000",
"country": "United States"
},
"technologies": ["Apache", "PHP", "jQuery", "Google Analytics"],
"popularity": {
"openrank": 8.2,
"traffic_rank": 15420
},
"domain_age": "1995-01-15",
"safety_score": 95
},
"total_credits": 100000,
"remaining_credits": 99999
}
Bulk Data Access
For large-scale operations, we offer bulk data delivery via CSV files and direct database access. Contact our team for enterprise pricing and delivery options.
CSV File Delivery
Download complete datasets via secure links, with options for full database exports or filtered subsets based on categories, geography, or other criteria.
Code Examples
Below you can find minimal example code for using our API in different programming languages.
Python Example
import http.client
import urllib.parse
import json
conn = http.client.HTTPSConnection("www.urlcategorizationdatabase.com")
payload = urllib.parse.urlencode({
'domain': 'github.com',
'fields': 'iab_categories,company,technologies',
'api_key': 'your_api_key'
})
headers = {
'Content-Type': 'application/x-www-form-urlencoded'
}
conn.request("POST", "/api/lookup", payload, headers)
response = conn.getresponse()
data = json.loads(response.read().decode("utf-8"))
print(f"Domain: {data['domain']}")
print(f"Primary Category: {data['data']['iab_categories']['primary']}")
JavaScript Example
const myHeaders = new Headers();
myHeaders.append("Content-Type", "application/x-www-form-urlencoded");
const urlencoded = new URLSearchParams();
urlencoded.append("domain", "shopify.com");
urlencoded.append("fields", "iab_categories,technologies,company");
urlencoded.append("api_key", "your_api_key");
const requestOptions = {
method: 'POST',
headers: myHeaders,
body: urlencoded,
redirect: 'follow'
};
fetch("https://www.urlcategorizationdatabase.com/api/lookup", requestOptions)
.then(response => response.json())
.then(data => {
console.log("Domain:", data.domain);
console.log("Technologies:", data.data.technologies);
})
.catch(error => console.log('error', error));
Error Codes
The API returns a status
field in each response. Status 200 indicates success.
Error codes and their meanings:
Status Code | Description |
---|---|
200 | Success - Request completed successfully |
400 | Bad Request - Invalid request format or missing required parameters |
401 | Unauthorized - Invalid or missing API key |
403 | Forbidden - Insufficient credits or plan limits exceeded |
404 | Not Found - Domain not found in our database |
422 | Unprocessable Entity - Invalid domain format or unsupported parameters |
429 | Too Many Requests - Rate limit exceeded, please slow down requests |
500 | Internal Server Error - Please retry or contact support if issue persists |
Need Help?
For technical support, custom integrations, or enterprise solutions, contact our team at [email protected]