What are the responsibilities and job description for the Azure Databricks Engineer position at XFORIA Inc?
Job Description
Job Title: Azure Databricks Developer/ Engineer
Location: Remote, US
Mode: Contract
Responsibilities:
- Work as part of a team to develop Cloud Data and analytics solutions
- Design and implement performant data ingestion data flows from multiple sources using Databricks.
- Develop and maintain the required data mappings using Databricks
- Assist with and execute programming, modeling, and data integration, supporting task automation and DevOps practices.
- Experience working on building data ingestion pipelines from multiple data sources using Data Bricks and Apache Spark.
- Unit test to ensure the required performance through large-scale testing
- To provide job mentoring to the internal staff and allow them to grow, add best practices to the project.
Qualifications:
- Experience coding using T-SQL, Scala, or Python
- Spark with Scala programming language
- Development on Azure Databricks using Scala
- Code versioning tools such as Git
- Must have worked with Continuous Integration and deployment tools (CI/CD)
- Knowledge of Azure services such as Azure Storage, Azure Data Lake, Azure SQL Data Warehouse, Azure Cosmos DB, Azure Stream Analytics
- Azure DevOps build and release pipelines
- Data Warehouse, Datalake, Business Intelligence concepts
- Understanding of the Agile environment
- Development using SQL Server (T-SQL), SQL, and stored procedures
- End-to-end pipeline development on Azure Data Factory
Azure Databricks Engineer
GalaxE.Solutions -
Berkeley Heights, NJ
Azure Databricks Engineer
Crescens Inc. -
Berkeley Heights, NJ
Azure Databricks Engineer
Capgemini -
Bridgewater, PA