What are the responsibilities and job description for the Data Architect position at Cloud Resources LLC?
Job Details
Data Architect Palo Alto , CA - Hybrid
Design and manage databases using Cosmos DB, MongoDB, and PostgreSQL.
Develop and maintain efficient data models and ensure data consistency and integrity.
Develop and maintain distributed task processing using Celery and ensure robust task queue management with Redis or RabbitMQ.
Implement and manage Kafka Streams to handle real-time data processing and streaming requirements.
Proven experience with Airflow for data orchestration and workflow management.
Experience developing and managing webhooks using FastAPI and integrating with Functions.
Knowledge of Kafka Streams for real-time data processing.
Familiarity with Iceberg for data lake management and optimization
Healthcare domain experience
