- Designing and implementing scalable data architectures, including data lakes, data warehouses, data lakehouses on AWS.
- Developing distributed data processing systems using technologies like Dask, Ray and Spark.
- Optimizing data architectures for performance, scalability and cost-efficiency.
- Collaborating with cross-functional teams to design and deploy robust and efficient data pipelines.
- Ensuring high availability and fault tolerance of distributed data systems.
- Continuously evaluating and integrating emerging technologies into data architectures.
- 7+ years of professional experience in data engineering and software development.
- Deep knowledge of Python and Data Engineering tooling
- Strong experience with Distributed Systems, AWS, Ray, Spark, Presto, Dask, Pandas, Iceberg, Delta Lake, Hudi
- Strong experience in large data projects, building data pipelines with data lakes, warehouses and lakehouses
- Short term availability to support our engineering team
Freelance Data Architect - Antwerp, België - Gorilla
Beschrijving
Join Gorilla, a leading force in the utility industry's transformation towards a net-zero society. We're seeking a skilled Freelance Data Architect to contribute to our impactful projects and innovative solutions. We are currently looking for a freelance data architect with short term availability
Your Role:
As a Data Architect for our team engineering cloud-native data-intensive applications, your role involves:
Your expertise will be pivotal in architecting and optimizing data solutions to support our cloud-native applications, leveraging AWS services, Dask, Spark, Ray, and distributed systems to build scalable and efficient data pipelines.
Requirements
Benefits
Gorilla has a flat organizational structure that values feedback and promotes a culture of innovation. Join Gorilla and make a lasting impact in shaping the future of the utility industry.