ELEKS
(consulting) Senior Data Enginner (DataBricks) #40374
Sorry, this job was removed
Be an Early Applicant
Similar Jobs
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
As a Software Engineer, you will build and optimize cloud-based backend platform components and services, ensuring high standards of software quality and innovation.*
Top Skills:
AWSAzureC#C++GCPJavaKafkaMicroservicesNo-SqlRabbitMQRestful ApisSQL
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
As a Senior Software Engineer, you will design, develop, and maintain BlackLine's cloud-based applications, focusing on innovation and collaboration within an Agile environment.
Top Skills:
AWSAzureC#C++GCPJavaKafkaNo-SqlRabbitMQRestful ApisSQL
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
As a Software Engineer, you will develop and maintain cloud-based backend systems, focusing on optimization, scaling, and innovation in SaaS applications.
Top Skills:
AWSAzureC#C++GCPJavaKafkaMicroservicesNo-SqlRabbitMQRestful ApisSQL
ELEKS Software Engineering & Development Office is looking for a Senior Data Engineer (DataBricks) in Poland, Croatia, Eastern Europe, and Argentina.
ABOUT PROJECT
A multinational British-American company is one of the world’s largest insurance brokers, operating in the insurance domain and offering services in risk management, insurance, and reinsurance brokerage, as well as investment banking solutions.
REQUIREMENTS
- 4+ years of working experience as a Data Engineer
- Experience with Databricks (building pipelines, notebooks, Spark)
- Strong knowledge of Azure Data Factory (creating and configuring data flows, pipelines) will be a plus
- Experience with MS SQL Databases
- Hands-on experience with Cosmos DB
- Python programming
- Upper-Intermediate level of English
NICE TO HAVE
- Knowledge of Data Lakehouse architecture, experience with Microsoft Fabric
- Experience with Entity Framework (EF6)
- Experience in creating project templates and reusable components (e.g., NuGet packages)
- Experience with the Microsoft Azure platform for building and hosting microservices and data-driven solutions (App Services, Key Vault, AKS, Storage Queues)
- Familiarity with security protocols such as OAuth 2.0 (OKTA identity, OAuth, Identity Server, Azure AD, Managed Identity, Key Vaults)
- Hands-on experience in building RESTful APIs with API Management
- Good knowledge of CI/CD systems setup and configuration
- Understanding of Open API standards
- Familiarity with ORMs, especially Entity Framework 6
- Familiarity with DDD (Domain-Driven Design)
- Understanding of canonical API approaches
- Experience with various databases (Cosmos DB, MS SQL, etc.)
- Familiarity with APMs (Application Performance Management) tools
- Experience with H3 Mapping, Power BI
- Familiarity with file storage systems (Blob Storage, File Share, CDN)
RESPONSIBILITIES
- Develop solutions and algorithms according to technical specifications or other requirements documentation
- Analyze software code compliance with readability and performance standards
- Use version control systems to track code optimization progress, as well as to merge or split code entities. Commit changes according to version control rules
- Perform analysis, verification, and debugging of the software code at the level of application units
- Develop procedures to test code availability, collect diagnostic data, generate test data sets with desired characteristics; examine the required software characteristics, etc.
- Reproduce defects logged in the defect database, establish their causes, and modify code to eliminate defects
- Determine software product compliance with the technical requirements
- Collect and analyze results of software tests. Deliver correct interpretation of diagnostic data; analyze the significance of the obtained software characteristics; can document test results. Assess software product availability
- Develop, document, and edit programming interfaces, software modules and components assembling procedures, software deployment and update procedures, as well as data migration and transformation (conversion) procedures
- Assemble software modules and components into a software product; connect the software product to the external environment. Test the availability of software product versions
- Analyze variants of software requirements implementation; evaluate their time-consumption and workload. Conduct assessment and justification of the solutions recommended for software requirements implementation.
- Approve technical requirements for software with stakeholders. Evaluate and justify terms of task completion. Assign tasks to developers, monitor task implementation
WHAT YOU WILL GET WITH ELEKS
- Close cooperation with a customer
- Challenging tasks
- Competence development
- Team of professionals
- Dynamic environment with low level of bureaucracy
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
