IDT Logo

IDT

Senior Data Engineer

Posted Yesterday
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Panamá
Senior level
In-Office or Remote
Hiring Remotely in Panamá
Senior level
Designs, builds, and maintains scalable data pipelines, data warehouse architecture, feature stores, model-training workflows, and real-time inference services. Develops semantic search, vector database, RAG, LLM orchestration, dashboarding, and AI-powered BI solutions. Partners with stakeholders, documents workflows, supports model deployment, and applies data engineering and MLOps best practices using Python, Spark, Hadoop, Kafka, SQL, and cloud databases.
The summary above was generated by AI
This is a full-time opportunity for a Senior Data Engineer from LATAM.  
 
Only accepting applicants from LATAM. In-person verification will be conducted.
 
We are looking for a senior Data Engineer to join our BI team and take an active role in designing, building, and maintaining the end-to-end data pipeline, architecture and design that powers our warehouse, LLM-driven applications, and AI-based BI. 

Responsibilities:

  • Design, develop, and maintain scalable data pipelines to support ingestion, transformation, and delivery into centralized feature stores, model-training workflows, and real-time inference services.
  • Build and optimize workflows for extracting, storing, and retrieving semantic representations of unstructured data to enable advanced search and retrieval patterns.
  • Architect and implement lightweight analytics and dashboarding solutions that deliver natural language query experience and AI-backed insights.
  • Define and execute processes for managing prompt engineering techniques, orchestration flows, and model fine-tuning routines to power conversational interfaces.
  • Oversee vector data stores and develop efficient indexing methodologies to support retrieval-augmented generation (RAG) workflows.
  • Partner with data stakeholders to gather requirements for language-model initiatives and translate into scalable solutions.
  • Create and maintain comprehensive documentation for all data processes, workflows and model deployment routines.
  • Should be willing to stay informed and learn emerging methodologies in data engineering, MLOps and LLM operations.
  •  

Requirements:

  • 8+ years of experience as a Data Engineer.
  • Demonstrated experience in utilizing Python for data engineering tasks, including transformation, advanced data manipulation, and large-scale data processing.

  • Hands-on experience with big data technologies including Apache Spark, Hadoop, and Kafka for distributed processing and real-time data ingestion.

  • Experience designing complex data pipelines extracting data from RDBMS, JSON, API, and Flat file sources.

  • Demonstrated skills in SQL and PLSQL programming, with advanced mastery in Business Intelligence and data warehouse methodologies, along with hands-on experience in one or more relational database systems and cloud-based database services such as Snowflake/Redshift

  • Understanding of software engineering principles and skills working on Unix/Linux/Windows Operating systems, and experience with Agile methodologies.

  • Proficiency in version control systems, with experience in managing code repositories, branching, merging, and collaborating within a distributed development environment.

  • Interest in business operations and comprehensive understanding of how robust BI systems drive corporate profitability by enabling data-driven decision-making and strategic insights.
  • Effective oral and written English communication skills with BI team and user community.

Pluses

  • Experience with vector databases such as DataStax AstraDB, and developing LLM-powered applications using popular open source frameworks like LangChain and LlamaIndex–including prompt engineering, retrieval-augmented generation (RAG), and orchestration of intelligent workflows. 
  • Familiarity with evaluating and integrating open-source LLM frameworks–such as Hugging Face Transformers/LLaMA-4 across end-to-end workflows, including fine-tuning and inference optimization.
  • Knowledge of MLOps tooling and CI/CD pipelines to manage model versioning and automated deployments.
  •  

What we offer:

  • Remote work opportunity!
  • B2B Employment ($, gross).
  • Stable job with long-term growth perspective with talented people around.
  • Really good hardware.
  • Great learning and growth opportunities.
  • Compensation for professional training, seminars, and conferences.
  • Referral program – get rewarded for helping us grow the team with talented people.
  • Company-supported English classes to enhance your professional growth.

IDT Corporation is a global communications company founded in 1990 and headquartered in Newark, New Jersey. We are industry leaders in prepaid communication and payment services and one of the largest international voice carriers. We are listed on the NYSE, employ over 1800 people across 20 countries, and have over $1.5 billion in revenues. 

IDT is not ”another big IT corporation”— we encourage and support in-house entrepreneurs in developing their ideas into business actions.

Our flagship brand, BOSS Revolution, offers Money Transfer, International Calling, and Mobile Top-Up services and supports IDT’s mission of enabling people to keep in touch and share resources with family and friends worldwide.

 
Please attach CV in English.
The interview process will be conducted in English.
 
In-person verification will be conducted. Fake profiles will be reported.
 
Only accepting applicants from LATAM.

Similar Jobs

29 Days Ago
In-Office or Remote
Senior level
Senior level
Artificial Intelligence • Machine Learning • Database
Own end-to-end data engineering projects and build scalable ELT pipelines using Snowflake, dbt, and Airflow. Responsibilities include performance tuning, dimensional modeling, data warehousing, BI data preparation, platform modernization, automation, risk identification, and mentoring engineers. The role also supports future AI/ML data capabilities and requires strong independent delivery in a post-acquisition SaaS data environment.
Top Skills: Apache AirflowDatabricksDbtPower BIPythonSigmaSnowflakeSnowflake CortexTableau
Senior level
Artificial Intelligence • Machine Learning • Database
Build production LLM agents, multi-step workflows, MCP servers, evaluation and observability systems, and document-extraction pipelines. Architect AI-ready semantic data layers over Snowflake and dbt, develop Python ingestion and Airflow workloads, and implement retrieval, embeddings, governance, security, and reliable agent operations. Lead technical design, mentor peers, and advise clients in an embedded consulting engagement.
Top Skills: Anthropic Claude ApiApache AirflowAstronomerAWSAzureCi/CdClaude Agent SdkCortex AgentsCortex AisqlCortex AnalystCortex SearchDatabricksDbtDltDockerEcsEmbeddingsFargateGCPGitIamInfrastructure As CodeKafkaKinesisMcpMlflowOpenai Agents SdkPythonRagS3Secrets ManagerSnowflakeSnowflake CortexSnsSQLSqsVector Retrieval
One Month Ago
In-Office or Remote
50 Locations
Senior level
Senior level
Big Data • Healthtech • Software • Biotech
Build and maintain high-performance, fault-tolerant distributed backend services and data pipelines for large genomic and health datasets. Design storage, indexing, and async event workflows; optimize latency, throughput, and reliability. Partner with bioinformatics and product teams to validate scientific accuracy and guard AI-driven responses.
Top Skills: SparkAws SqsBullmqDuckdbPostgresQdrantRabbitMQRedisTypescript

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account