Dataspryva

Use Baidu Web, Image & News Results Extractor with Python

Runs search queries against Baidu's web, image, or news results and returns titles, URLs, snippets, dates, and image metadata, with filters for time range, file type, site, and exact phrase.

1. Choose the data you need

Review the published README for supported collection modes, examples, and limits. The recipe below uses the current published input definition.

2. Prepare a source-based input

This JSON contains published prefills and required-field defaults. Review every value for your task before running it; it is not a promise of successful collection.

{
  "excludeWords": [],
  "fileType": "any",
  "includeSerpFeatures": false,
  "language": "any",
  "maxResults": 3,
  "mode": "imageSearch",
  "queries": [
    "人工智能"
  ],
  "sortBy": "relevance",
  "timeRange": "any",
  "titleOnly": false
}

Download input.example.json and save your reviewed copy as input.json.

FieldTypeRequiredDescription
modestringoptionalWhich Baidu surface to scrape: web results, news, images, or autocomplete suggestions.
queriesarrayrequiredOne or more search terms. Each query is scraped independently up to maxResults.
maxResultsintegeroptionalMaximum number of results per query. Practical Baidu ceilings: web about 100, news about 140, images about 1500.
timeRangestringoptionalRestrict web results to a publication window. Applies to web search only; news has its own sort order.
dateFromstringoptionalStart of a custom publication window (YYYY-MM-DD). Overrides the time range. Web and news search only.
dateTostringoptionalEnd of a custom publication window (YYYY-MM-DD). Overrides the time range. Web and news search only.
fileTypestringoptionalRestrict web results to a file format using Baidu's filetype: operator. Web search only.
sortBystringoptionalOrder news results by relevance or by publication time. Applies to news search only.
languagestringoptionalRestrict web results to pages written in Simplified or Traditional Chinese. Web search only.
siteRestrictstringoptionalLimit web results to one website domain, e.g. wikipedia.org (site: operator). Web search only.
exactPhrasestringoptionalRequire web results to contain this exact phrase (quoted automatically). Web search only.
excludeWordsarrayoptionalWords to exclude from web results, one per line. Web search only.
titleOnlybooleanoptionalMatch the query against page titles only (intitle: operator). Web search only.
includeSerpFeaturesbooleanoptionalAlso return Baidu's answer box, knowledge panel, related searches and related videos as separate rows. Web search only.

3. Start an Actor run

Set APIFY_TOKEN in your environment. Python 3.10 or newer is sufficient; this recipe uses no third-party packages.

Execution may incur charges. Review current pricing on Apify. The request asks for a 120-second timeout and a charge limit; these settings are subject to Apify’s pricing and do not guarantee an all-inclusive spending cap.

import json
import os
import urllib.request

# Save the schema-derived example as input.json; review and edit it first.
with open("input.json", encoding="utf-8") as stream:
    actor_input = json.load(stream)

token = os.environ["APIFY_TOKEN"]
request = urllib.request.Request(
    "https://api.apify.com/v2/acts/psB9o5eBtflSKjKWE/runs?timeout=120&maxTotalChargeUsd=0.50",
    data=json.dumps(actor_input).encode("utf-8"),
    headers={"Authorization": "Bearer " + token, "Content-Type": "application/json"},
    method="POST",
)
# This starts a potentially billable run. Do not automatically retry this POST.
with urllib.request.urlopen(request, timeout=40) as response:
    run = json.load(response)["data"]
print("Run ID:", run["id"])
print("Status:", run["status"])
# Inspect and download results in Apify Console once the run succeeds.

4. Inspect the actual results

Open the run in Apify Console and wait for a successful completion. Use the published output schema to locate results and the dataset schema to understand declared views. Missing or optional record fields must not be treated as guaranteed values.

Baidu results — web organic rows (with real destination URLs, publisher, dates and images), news articles, image rows with original and thumbnail URLs, autocomplete suggestions, and optional SERP-feature rows.

Questions before you run

Which inputs are required?

The published required fields are queries

What does this guide verify?

The fields, prefills, and schema links are rendered from the published build. This is a usage recipe, not a paid live extraction test. Source availability and collection results can vary.

What if the run request times out?

Check Apify Console before retrying. The first request may already have created a run. Do not automatically repeat a run-creation POST.

Generated from source build jthHKZPxOzYQB27j5 and its README and schemas. Source changes regenerate this guide; no third-party editorial claims are inferred.