Back-end Developer
We are seeking a talented Back-end Developer with strong Python skills to build and maintain our high-volume data pipelines and internal tools. You will be at the heart of our data ingestion, streaming, and ETL solutions, primarily leveraging GCP technologies, and working on NLP and event-driven architectures.
At Semantic Visions, we collect data from various sources, enrich it, and extract valuable insights for our clients. We process and categorize 1.5 million news articles daily in 12 languages, extracting information about entities and events, analyzing the data, and providing insights to our clients. Additionally, we are developing an internal platform for our team of language specialists to work with the data. Are you interested in joining our Software Innovation team?
We are seeking a talented Back-end Developer with strong Python skills to build and maintain our high-volume data pipelines and internal tools. You will be at the heart of our data ingestion, streaming, and ETL solutions, primarily leveraging GCP technologies, and working on NLP and event-driven architectures.
Key Responsibilities:
- Develop, maintain, and optimize Python-based data pipelines on GCP (Dataflow, Pub/Sub, Kubernetes).
- Implement and refine event-driven solutions (Pub/Sub, sockets, RabbitMQ, etc.).
- Integrate and optimize various databases, including BigQuery, ArangoDB, Postgres, and Elasticsearch.
- Collaborate on crawling/scraping improvements and NLP-related features.
- Design, build, and maintain REST APIs and microservices (e.g., using Flask or similar frameworks).
- Deploy and troubleshoot services in Kubernetes or Debian Linux environments.
- Work closely with the front-end developer to ensure seamless data integration for internal tools.
Skills We Are Looking For:
- Proven Python development experience, including multiprocessing and parallelization.
- Hands-on background in event-driven architecture and queue systems (RabbitMQ, Pub/Sub, etc.).
- Experience with NoSQL/graph databases (Redis, ArangoDB, Elasticsearch) and SQL (PostgreSQL).
- Experience with REST APIs / JSON-RPC and building microservices.
- Familiarity with GitLab CI/CD or similar CI/CD pipelines.
- Comfortable with large-scale data processing and optimization techniques.
- Experience with cloud platforms, preferably GCP.
Qualities We Value:
- A problem-solving mindset and proactive attitude.
- Willingness to learn, adapt, and embrace new technologies.
- A team player who communicates effectively and collaborates well.
- Enthusiasm for big data, NLP, and distributed systems.
What we offer:
- A say in technical decisions and participation on interesting problem solving
- Flexible work model and office in the center
- A supportive and collaborative team culture
- Training, certifications, and space to grow
- Team events