Infrastructure
Scraping Monitor
Real-time data pipeline status, Elasticsearch indices, and multi-source search.
Elasticsearch
Redis
Total Documents
Across all ES indices
Active Scrapers
Enabled / Total
Elasticsearch Indices
Document counts per index. Click "Refresh" to update live.
| Index | Documents | Size | Bar |
|---|---|---|---|
|
|
Source Distribution
Documents by index.
Scraping Tasks
Celery Beat scheduled tasks.
| Task | Schedule | Status | Runs | Last Run | |
|---|---|---|---|---|---|
No scheduled tasks. Run python manage.py setup_elasticsearch --schedules to create them.
|
|||||
Data Pipeline
CSV ingest and LLM classification progress.
508,577
Total Comments
469,744
Sentiment Classified (92.4%)
LLM Labeled (%)
LLM labeling progress
unlabeled
Multi-Source Search
Search across all data sources simultaneously via Elasticsearch.
Found results
for ""
No results found.