Develop a web crawling and scraping system to collect relevant data from a list of websites.
Extract and process meaningful content from crawled pages.
Integrate AI/LLM capabilities to analyze website content and evaluate whether the company fits a target industry vertical.
Design a scoring or ranking mechanism that qualifies and prioritizes leads.
Produce a structured output containing qualified leads with clear reasoning or scoring.
Deliver a standalone, well-structured application ready for handover to the client.

Experience with web scraping and crawling tools such as BeautifulSoup, Scrapy, Playwright, Puppeteer, or similar frameworks.
Strong knowledge of content extraction and text analysis.
Hands-on experience integrating AI / LLM APIs (e.g., OpenAI, Anthropic, or open-source models).
Ability to design and build clean, maintainable software products, not just quick prototypes.
Familiarity with modern development stacks and best practices.
Nice to Have: Experience in lead generation, marketing technology, or sales intelligence tools.
Knowledge of prompt engineering, particularly for multilingual or non-English content.
Experience building end-to-end AI-powered tools or automation solutions.
German language skills are a plus but not required (language support will be provided by the client).

Freelance AI & Web Scraping Developer

Key skills