Archived project — no longer maintained. Job collection was shut down on 24 Jun 2026 and the live database is offline. Everything you see here is demo data.

jobTakt: German Job Market Intelligence

A data engineering project that tracked the German job market from 30 Dec 2025 to 24 Jun 2026.

The pipeline is retired — this site is kept online as a portfolio piece, running on demo data.

Data Insight

Snapshot as of 24 Jun 2026 · demo data

View Insights
Total Jobs
0
Total Companies
0
New Today
0
New This Week
0

Active jobs by company size (German index)

A Glimpse of the Pipeline

Data flows from multiple sources, is processed and stored, then served to the frontend.

Data Sources
Smart Scripts
Validation
Database
API
Web UI
Click to explore the full architecture

Core Project Features

This project demonstrates a wide range of data engineering principles and practices.

Centralized Database

All job data is stored in a single, unified PostgreSQL database, acting as the single source of truth.

Automated Refresh

While active, the data pipeline ran automatically multiple times a day, keeping the job board up-to-date.

Data Unification

Jobs from various sources are transformed and loaded into a standardized format for consistency.

Dynamic Filtering

The frontend allows users to filter jobs by location, keywords, and other criteria in real-time.

Scalable Design

The architecture is built to handle a growing number of data sources and increasing data volume with ease.

Pipeline Monitoring

The system logs recent activities and key metrics, providing a clear view of the pipeline's health and performance.

Final Pipeline Activity

The last harvesting runs before the pipeline was shut down on 24 Jun 2026.

  • Scraped DHL Group: Found 1087 jobs (1 new).

    24 Jun 2026, 20:04

  • Scraped adesso: Found 295 jobs (6 new).

    24 Jun 2026, 20:01

  • Failed to scrape AXA Germany. Status: failed.

    24 Jun 2026, 19:59

  • Scraped Zalando: Found 178 jobs (1 new).

    24 Jun 2026, 19:56

  • Scraped Deutsche Bank: Found 132 jobs (2 new).

    24 Jun 2026, 19:54