In this role, you'll build and maintain data pipelines, ensure data quality, and collaborate on data engineering projects to support our energy management platform.
Help us use technology to make a big green dent in the universe!
Kraken powers some of the most innovative global developments in energy.
We’re a technology company focused on creating a smart, sustainable energy system. From optimising renewable generation, creating a more intelligent grid and enabling utilities to provide excellent customer experiences, our operating system for energy is transforming the industry around the world in a way that benefits everyone.
It’s a really exciting time in energy. Help us make a real impact on shaping a better, more sustainable future.
About Our Data Platform Team
What we do: build the most AI-driven, innovative, forward-thinking platform for energy management. From optimising resources to delivering cost-effective, exceptional customer experiences through advanced Customer Information Systems (CIS), billing, meter data management, CRM, and AI-driven communications, Kraken is powering the next wave of innovation in the energy industry.
Why we do it: future energy will not look like energy as we know it today. We need to not just think about our future, but build for it. Now.
At Kraken we've developed a data platform that is used by Octopus Energy and our other clients retail energy businesses around the world.
The platform empowers users with self-service data analytics and automates our data processing workflows, from simple ETL jobs to ML training and prediction.
The data platform team works across the whole customer domain on anything from natural language understanding of our customer communications to processing billions of smart meter readings every day to support clients in creating customised and market leading smart energy tariffs.
As the volume, scope and geographical range of our data offerings rapidly expand, we're looking for an experienced data engineer to join the team to help us build and maintain our platform, pipelines and data sources.
We're passionate about building great technology to change the way customers use, and think about, energy for the good of the planet. This is a fantastic opportunity to work with us on data problems that genuinely move us closer to Net Zero, and support the energy transition.
What you'll do:
- Build new data sources and data pipelines that deliver key data and insights to the business.
- Build data pipelines that power and enable the inner workings of the Kraken platform, from billing and settlement to customer-facing apps.
- Build and maintain testing and documentation frameworks for our data sources.
- Work with the business to scope and deliver new data engineering projects and requirements.
- Maintain and build on our existing data infrastructure and tools.
- Support the internationalisation of our data infrastructure as we continue to grow globally.
- Data Engineer II corresponds to a mid level role at Kraken.
What you'll have:
- First and foremost, we want our data engineers to be great software engineers with a passion for writing high quality code.
- Python
- SQL
- Spark / PySpark
- Experience in assuring data quality
- Experience deploying data services in a cloud environment (ideally AWS)
- Experience with APIs designed for high volume traffic serving data to customers or business critical applications.
- Experience with relational databases (Postgres/Aurora)
- The projects will be varied and we're looking for someone who can work autonomously and proactively to scope problems and solve and deliver pragmatic solutions.
- We are ideally looking for someone based in ET timezone
It would be helpful to have experience/expertise in the following:
Why you'll love it here:
- Great medical, dental, and vision insurance options including FSAs.
- Paid time off — we know working hard means also being able to recharge as needed, we trust our employees to get the work done and take the time they need.
- 401(k) plan with employer match.
- Parental leave. Biological, adoptive and foster parents are all eligible.
- Pre-tax commuter benefits.
- Flexible working environment: you need to shift around your schedule? You do you, we genuinely believe in work/life balance.
- Equity Options: every Octopus employee owns part of the business. We’re a team, working together towards huge goals. Every person is crucial to our success, you should be rewarded as such.
- Modern office or co-working spaces depending on location.
- The salary range for this role ranges on average from $80,000 - $140,000 (with some flexibility) depending on relevant experience. While the broad salary range is listed, not all candidates will be placed at the top of the range—this will be determined by the overall fit for the position. If you have questions about this, just ask! Our recruiters are happy to provide more context.
Kraken is a certified Great Place to Work in France, Germany, Spain, Japan and Australia. In the UK we are one of the Best Workplaces on Glassdoor with a score of 4.7. Check out our Welcome to the Jungle site (FR/EN) to learn more about our teams and culture.
Are you ready for a career with us? We want to ensure you have all the tools and environment you need to unleash your potential. If you have any specific accommodations or a unique preference, please contact us at [email protected] and we'll do what we can to customise your interview process for comfort and maximum magic!
Studies have shown that some groups of people, like women, are less likely to apply to a role unless they meet 100% of the job requirements. Whoever you are, if you like one of our jobs, we encourage you to apply as you might just be the candidate we hire. Across Kraken, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. We consider all applicants without regard to race, colour, religion, national origin, age, sex, gender identity or expression, sexual orientation, marital or veteran status, disability, or any other legally protected status. U.S. based candidates can learn more about their EEO rights here.
Our (i) Applicant and Candidate Privacy Notice and Artificial Intelligence (AI) Notice, (ii) Website Privacy Notice and (iii) Cookie Notice govern the collection and use of your personal data in connection with your application and use of our website. These policies explain how we handle your data and outline your rights under applicable laws, including, but not limited to, the General Data Protection Regulation (GDPR) and the California Consumer Privacy Act (CCPA). Depending on your location, you may have the right to access, correct, or delete your information, object to processing, or withdraw consent. By applying, you acknowledge that you’ve read, understood and consent to these terms
Top Skills
APIs
Aurora
AWS
Postgres
Pyspark
Python
Spark
SQL
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Software Engineer II, you'll work on data ingestion at petabyte-scale, collaborating with teams to develop distributed systems, optimize performance, and ensure high quality through testing and improvement practices.
Top Skills:
AWSAzureGCPGoKafkaScala
Fintech • Machine Learning • Social Impact • Software • Financial Services
As an Engineer II at TrueML, you will develop data streaming platforms, manage cloud infrastructure, and collaborate on project deliveries with minimal assistance.
Top Skills:
Amazon Web ServicesAWSFlinkGoGoIacInfrastructure As CodeKafkaScalaSpark StreamingTerraform
AdTech • Automotive • Big Data • Consumer Web
As a Senior Data Engineer, you'll create and maintain data pipelines, collaborate on data infrastructure needs, and automate processes to improve data delivery and scalability.
Top Skills:
AirflowAWSDatabricksJavaPythonScalaSparkSQL
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
