Experience
Python development, Google Cloud Platform
Work level
Medior level
Job types
Full-time
Offer salary
We are seeking a dedicated and experienced Data Processing Engineer with extensive Python knowledge to join our dynamic team. The successful candidate will be responsible for developing pipelines in Apache Beam and should have extensive knowledge in GCP, event streaming, and event-driven architecture. This role offers an excellent opportunity for growth and to work on cutting-edge technologies.
Key Responsibilities:
- Design, develop, and deploy pipelines in Apache Beam / Google Dataflow.
- Work closely with the team to integrate solutions with GCP services.
- Contribute to the development of event-driven architecture solutions.
- Contribute to NLP-related projects and tasks as necessary.
- Ensure the smooth and efficient running of our applications in GCP or in Debian Linux.
Requirements:
- Proven experience in Python development.
- Experience with REST API, JSON-RPC, and similar protocols.
- Hands-on experience in developing pipelines in Apache Beam.
- Knowledge of Google Cloud Platform (GCP).
- Familiarity with Gitlab pipelines.
- Knowledge in integrating and working with REST API, JSON-RPC, or similar.
- Understand message queue concepts using RabbitMQ, Kafka, PubSub, etc. and experience with event-driven architecture.
- Proficiency in using SQL databases, especially PostgreSQL, as well as document oriented databases and/or graph databases.
Qualities We Value:
- Problem-solving attitude.
- Ability to work collaboratively in a team environment.
- Continuous learner, willing to adapt and grow with the company.
