Data Engineer

Location: This position is remote within Colombia

Huge is looking for a Data Engineer to join our Data Products team.  

What You’ll Be Doing.

• Data Pipeline Monitoring: Monitor the health and performance of existing data pipelines and ETL (Extract, Transform, Load) processes. Use monitoring tools and dashboards to identify and resolve any data processing issues, bottlenecks, or failures. Collaborate with the operations team or developers to troubleshoot and resolve these issues.
• Data Transformation and Processing: Develop, test, and maintain data transformation and processing jobs. Use cloud-native technologies and frameworks such as Apache Spark, Apache Beam, or cloud-specific tools like AWS Glue or Google Cloud Dataflow to transform raw data into usable formats for downstream applications. Write and optimize SQL queries or code for data transformations.
• Data Quality and Governance: Ensure data quality and adherence to data governance policies and standards. Collaborate with data analysts, data scientists, and other stakeholders to understand their data requirements and provide them with clean, reliable, and well-structured data. Implement data validation checks, data profiling, and data cleansing processes as necessary.
• Infrastructure Management: Collaborate with the DevOps or infrastructure team to manage and optimize cloud-native infrastructure resources. This includes provisioning and configuring data storage systems like AWS S3, Google Cloud Storage, or Azure Data Lake, as well as managing compute resources such as AWS EMR, Google Cloud Dataproc, or Azure HDInsight for big data processing.

What We’d Like To See.

• Data Engineer Skills: Google Cloud Platform (GCP) Expertise: In-depth knowledge and hands-on experience with GCP services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, Dataproc, Data Catalog, and others. 
• Strong understanding of data engineering concepts, data modeling, data warehousing, ETL/ELT processes, data integration techniques, and best practices. 
• Proficiency in designing and building scalable and efficient data pipelines using GCP tools and technologies, ensuring optimized data ingestion, transformation, and loading processes. 
• Strong programming skills in languages such as Python, Java, or Scala for data engineering tasks, scripting, and automation.
• Proficient in writing complex SQL queries, optimizing query performance, and utilizing query tuning techniques for efficient data retrieval and manipulation. 
• Expertise in designing and optimizing data storage systems on GCP, including data partitioning, schema design, and performance tuning.

About Huge

Huge is a creative consultancy powered by human and AI collaboration. We partner with the world’s most ambitious brands to Make Huge Moves, which are creative solutions that deliver powerful outcomes. Huge helps clients unlock meaningful growth in areas ranging from AI business consulting, brand and customer experience, technology advisory, and strategy, to high-value audience analysis and product innovation. Founded in 1999 in Brooklyn, NY, Huge has more than 1,200 employees working across North America, Europe, Asia, and Latin America. The consultancy is part of the Interpublic Group of Companies. For more information, visit www.hugeinc.com.

Huge is committed to creating an inclusive employee experience for all. Regardless of race, gender, religion, sexual orientation, age, disability, or if you’re parenting the next generation of innovators, we firmly believe that our work is at its best when everyone feels free to be their most authentic self.

Huge is an equal opportunity employer (EOE). We strongly support diversity in the workforce. We are committed to an inclusive, barrier-free recruitment and selection process and work environment. If you are contacted for a job opportunity, please advise us of any accommodation needed to ensure you have access to a fair and equitable process. Any information received relating to accommodation will be addressed confidentially.

#LI-POST #LI-Remote