The Data Pipeline design.

Here you will find the description of the architecture and design of the data pipeline of Décoder l'éco, for the eurostat data.

//... A description of my image.
GITHUB
DECODER_LECO
DATASOURCE
GITHUB...
EUROSTAT
DATASOURCE
EUROSTAT...
Population
on 
January, the 1st
Population...
Popuplation 
Baseline
Projections 
2019/2024
Popuplation...
Popuplation 
Baseline
Projections 
2019/2024
-
AFTER T1
Popuplation...
Transform
Transform
Transform
Transform
es_pjan_2021
-
AFTER T2
es_pjan_2021...
Transform
INNER JOIN
ON THE 
TIME
COLUMN
Transform...
es_pjan
-
AFTER T1
es_pjan...
Transform
Transform
es_pjan_2021
-
AFTER T3
es_pjan_2021...
FROM LINE ZERO 
TO
LINE 213 
OF R CODE
ONLY THOSE 2 DATA SOURCES 
ARE INVOLDVED IN TRANSFORMATIONS
FROM LINE ZERO...
demo_pjan
demo_pjan
proj_19np__custom_2224172_linear.csv
proj_19np__custom_2224172_linear.csv
INGESTION
INGESTION
INGESTION
INGESTION
proj_2023
proj_2023
proj_2022
proj_2022
proj_2024
proj_2024
proj_2023_2024
proj_2023_2024
proj_2022_2023
proj_2022_2023
es_pjan
es_pjan
es_pjan_2023
es_pjan_2023
Transform
Transform
Transform
Transform
Transform
Transform
Transform
LEFT JOIN
ON THE 
?
COLUMN
Transform...
Transform
LEFT JOIN
ON THE 
?
COLUMN
Transform...
Transform
LEFT JOIN
ON THE 
?
COLUMN
Transform...
es_pjan_2024
es_pjan_2024
TRANSFOFRM
TRANSFOFRM
es_pjan_2022
-
AFTER T2
es_pjan_2022...
Transform
Transform
es_pjan_2023
es_pjan_2023
Transform
Transform
es_pjan_2024
es_pjan_2024
TRANSFOFRM
TRANSFOFRM
TRANSFOFRM
TRANSFOFRM
es_pjan_age
es_pjan_age
es_age_max_pop
es_age_max_pop
TRANSFOFRM
TRANSFOFRM
TRANSFOFRM
TRANSFOFRM