Data Engineer
We are currently approved to hire in: MA, NY, NJ, TX, CA
PS AI Labs aims to provides exceptional data analytic and strategy services built upon our culture of Discovery, Humility, Integrity, Enthusiasm, and Community, enabling our clients to achieve demonstrably better business outcomes and advance their most important objectives.
PS AI Labs is looking to hire a Data Engineer who can support robust and repeatable data manipulation, large scale infrastructure for data ingestion, and stunning data visualization for custom client applications. A Data Engineer works collaboratively with data scientists, business consultants, and software engineers to create and deploy dynamic data applications that help our customers make meaningful business decisions. Candidates should have the ability and the willingness to tailor applications to a client’s business goals using an iterative methodology. Candidates should also be able to consider both long-term stability and scalability while taking a user-focused approach to development and deployment.
Focus areas: data manipulation, big data architecture, data structures, database administration, cloud platforms and SaaS, development operations (devops), data visualization and user experience
Selected Technologies:
Databases:
·SQL-based technologies (e.g. PostgreSQL and MySQL, Oracle)
·NoSQL technologies (e.g. Cassandra, MongoDB, Graph Database)
Big Data:
·Spark/Databricks (RDD, Data Frames, GraphX)
·Hadoop (e.g. MapReduce, Hive and Pig)
ETL and Data Integration:
·Kettle/Spoon, Luigi, Jenkins, Airflow, Nifi
Indexers/Search Engines:
·ElasticSearch, Solr
Cloud:
·AWS, Azure, stack configuration and management
Deployment:
·Docker
Languages:
·Python, Java, Scala, Familiarity with R
O/S:
·UNIX, Linux, Solaris, ssh, git
Responsibilities:
·Develop and deploy robust data pipelines and end-to-end systems
·Participate in every stage of the engineering lifecycle, from ideation and requirements gathering through implementation, testing, deployment, and maintenance
·Provide leadership and coordination for certain stages of the engineering lifecycle as needed
·Perform other technical tasks as needed, including writing project reports, managing, implementing, and/or maintaining technical infrastructure, etc.
Requirements:
·Bachelors or Master’s degree in Computer Science or related field, or equivalent experience
·Excellent written and verbal communication skills
·Ability to work with high-level mathematical concepts and associated code-form representations
Useful skills and experience:
·Data manipulation, SQL, relational databases, and/or NoSQL databases – experience as a DBA is a huge plus
·Cloud platform development and SaaS
·DevOps – infrastructure, continuous integration and automation, packaging and deployment
·Consulting experience is a plus