"AI" has become a marketing word. Every job platform claims to use it; few explain what the AI actually does. This post is the explanation. We will walk through the four stages of Kariyan's pipeline, in plain English, and call out exactly where machine learning adds value, where it does not, and where you (the candidate) stay firmly in control.
Stage 1: Career Page Discovery
Kariyan does not scrape job boards. We crawl company career pages directly, a Telekom listing comes from telekom.de/karriere, a Zalando listing comes from corporate.zalando.com, and so on. There are roughly 7,500 active career pages in our index right now, refreshed on a schedule that ranges from hourly for high-volume employers to weekly for smaller companies.
This stage uses almost no AI. It is mostly a deterministic crawler: fetch the page, follow the "Open Positions" link, parse the HTML structure, identify individual job postings. We use small classifier models for two narrow tasks: detecting whether a page is a job listing or marketing copy, and extracting the structured fields (title, location, posted date) when the page has no schema.org markup.
Why career pages and not LinkedIn?
Career pages are the source of truth. By the time a job appears on Indeed or LinkedIn, it has already been on the company's own page for hours or days, and the most motivated applicants have already submitted. Kariyan reads from the source, so you see fresh roles before they reach the crowded platforms.
Stage 2: Job Extraction
Once a posting is captured, an extraction model converts the free-form HTML into structured fields: required skills, preferred skills, seniority hint, work model (remote/hybrid/onsite), language requirements, salary range if disclosed, and a short summary.
This is where the first non-trivial AI shows up. We use a fine-tuned LLM with a constrained JSON output schema, and a deterministic post-processor that validates every extracted field. If the model emits a salary that is not numeric, the post-processor drops the field rather than guess. The data you see in your matches is what we could verify, never what we hallucinated.



