Use We Work Remotely Job Listings & Salary Extractor with Python
Reads We Work Remotely category pages or keyword search results and follows each listing for salary range, employment type, skills, applicant region requirements, and company details.
1. Choose the data you need
Review the published README for supported collection modes, examples, and limits. The recipe below uses the current published input definition.
2. Prepare a source-based input
This JSON contains published prefills and required-field defaults. Review every value for your task before running it; it is not a promise of successful collection.
{
"categories": [
"remote-full-stack-programming-jobs"
],
"cleanHtml": true,
"countries": [],
"employmentTypes": [],
"includeCompanyProfile": false,
"includeDescription": true,
"includeDetails": false,
"incremental": false,
"maxItems": 3,
"mode": "browse",
"postedWithin": "any",
"regions": [],
"requireSalary": false,
"startUrls": []
}
Download input.example.json and save your reviewed copy as input.json.
| Field | Type | Required | Description |
|---|---|---|---|
mode | string | required | What to scrape. browse reads category feeds, search filters the full current inventory, byUrls accepts We Work Remotely links. |
categories | array | optional | One or more categories. Leave empty to collect every category (recommended for the full inventory). |
searchTerm | string | optional | Words to match in the title, company, category or description. All words must match. Required in search mode. |
startUrls | array | optional | Job, category, search, company or listing URLs. Mix freely. (mode=byUrls) |
employmentTypes | array | optional | Employment types to keep. Leave empty for all. We Work Remotely publishes Full-Time and Contract roles. |
regions | array | optional | Keep jobs open to one or more regions. Jobs open worldwide always match. Leave empty for all. |
countries | array | optional | Keep jobs open to one or more countries (ISO-2 codes). Jobs open worldwide always match. Leave empty for all. |
postedWithin | string | optional | Keep jobs listed within this window. The listing date is the current (renewed) date, not the original post date. |
minSalary | integer | optional | Minimum annualized salary in USD. Jobs without a disclosed salary are kept unless requireSalary is on. Published currencies are not converted. |
maxSalary | integer | optional | Maximum annualized salary in USD. Jobs without a disclosed salary are kept unless requireSalary is on. Published currencies are not converted. |
requireSalary | boolean | optional | Only keep jobs with a confidently parsed salary range. Off by default so jobs that do not disclose pay are not lost. |
includeDescription | boolean | optional | Include the full description HTML and text. Salary is parsed even when this is off. |
cleanHtml | boolean | optional | Remove scripts, tracking pixels and unsafe attributes from descriptionHtml. |
includeDetails | boolean | optional | Also fetch each job's HTML page for extra structured fields. The public job XML (apply URL/email, company bio, exact dates) is always read. Off by default; adds one HTML request per job. |
includeCompanyProfile | boolean | optional | Fetch the company profile for each emitted job (website, logo, about, open-job count). On by default; adds one request per company. |
incremental | boolean | optional | Only return jobs that are new or renewed since the previous run of the same search. State is stored automatically. |
stateKey | string | optional | Optional name for an incremental campaign. Leave empty to derive it from the search filters. |
maxItems | integer | optional | Maximum jobs to return (1-5000). |
3. Start an Actor run
Set APIFY_TOKEN in your environment. Python 3.10 or newer is sufficient; this recipe uses no third-party packages.
Execution may incur charges. Review current pricing on Apify. The request asks for a 120-second timeout and a charge limit; these settings are subject to Apify’s pricing and do not guarantee an all-inclusive spending cap.
import json
import os
import urllib.request
# Save the schema-derived example as input.json; review and edit it first.
with open("input.json", encoding="utf-8") as stream:
actor_input = json.load(stream)
token = os.environ["APIFY_TOKEN"]
request = urllib.request.Request(
"https://api.apify.com/v2/acts/u2oA6UQc4XzfqURHB/runs?timeout=120&maxTotalChargeUsd=0.50",
data=json.dumps(actor_input).encode("utf-8"),
headers={"Authorization": "Bearer " + token, "Content-Type": "application/json"},
method="POST",
)
# This starts a potentially billable run. Do not automatically retry this POST.
with urllib.request.urlopen(request, timeout=40) as response:
run = json.load(response)["data"]
print("Run ID:", run["id"])
print("Status:", run["status"])
# Inspect and download results in Apify Console once the run succeeds.
4. Inspect the actual results
Open the run in Apify Console and wait for a successful completion. Use the published output schema to locate results and the dataset schema to understand declared views. Missing or optional record fields must not be treated as guaranteed values.
Dataset of live We Work Remotely jobs with title, company, category, applicant regions and countries, parsed salary range, skills, full description, company profile, application URL or email, listing and expiry dates.
Questions before you run
Which inputs are required?
The published required fields are mode
What does this guide verify?
The fields, prefills, and schema links are rendered from the published build. This is a usage recipe, not a paid live extraction test. Source availability and collection results can vary.
What if the run request times out?
Check Apify Console before retrying. The first request may already have created a run. Do not automatically repeat a run-creation POST.
Generated from source build eb6rHgNVPPgCCl1qp and its README and schemas. Source changes regenerate this guide; no third-party editorial claims are inferred.