Freelance Data Engineer
Multiple data engineers needed to improve reliability, efficiency and throughput of data ingestion pipelines (500,000 hours of driving data, 100PB), debugging ingestion pipelines, orchestrating multi-step workflows, optimising Spark jobs, for 6 months+.