mirrors/15min_solar_generation

☀️ Solar PV Generation – Spain (15-Minute Resolution) This project collects and stores real-time 15-minute solar photovoltaic (PV) generation data for the Peninsular region of Spain using the official Red Eléctrica de España (ESIOS) API.

We built a fully automated data pipeline that updates every 15 minutes and stores results in structured daily files — ready for analysis, modeling, or dashboards.

📁 Folder Structure

data/
→ Daily CSV files saved as YYYY-MM-DD.csv (15-minute resolution).

scripts/
→ Python script for fetching solar data from ESIOS.

.github/workflows/
→ GitHub Actions automation (runs every 15 minutes).

🔄 What’s Automated?

✅ Real-Time Fetching (collect_solar_15min.yml)

Pulls 15-minute PV generation data via ESIOS API
Runs every 15 minutes using GitHub Actions
Saves updated CSV file in data/YYYY-MM-DD.csv
Avoids duplicates, merges safely

✅ Timezone-Aware Storage

Tracks Spain local calendar (Europe/Madrid)
Converts timestamps to UTC for consistency
File is named by local date (e.g. 2025-04-14.csv)

🧠 Scripts

collect_today_15min.py

Converts local Spain time to UTC
Sends API request using time_trunc = "quarter-hour"
Loads today’s CSV (if it exists)
Appends new 15-minute records
Deduplicates by timestamp
Saves updated result

🛠 Tech Stack

Python 3.11
Pandas
Requests
GitHub Actions
Red Eléctrica de España (ESIOS API)

📡 Data Source

Provider: Red Eléctrica de España (REE)
API: https://api.esios.ree.es/
Indicator: 541 (Solar PV Generation - Peninsular)
Timezone: Timestamps saved in UTC, files named in Spain time

🗺️ Roadmap

✅ Collect 15-minute solar PV generation
✅ Store daily files in data/ folder
✅ GitHub Actions automation
🔜 Add Parquet + DuckDB versions
🔜 Backfill data from 2023
🔜 Add real-time dashboard (Streamlit or Looker)
🔜 Merge with weather + OMIE price data
🔜 BESS optimization models using solar input

👤 Author

Please cite or credit if you use this project for academic, research, or commercial purposes.

⚡ Let the sunlight power your models.