Key skills
PythonSQLShellMLPandasETLSparkKafkaRedisLDAPGrafanaRabbitMQAgileScrum
About this role
Kforce Inc is seeking a Data Engineer to join their team in New York, NY. The role involves writing efficient Python and SQL code, troubleshooting operational issues, and working within the Scrum Framework and Agile methodologies.
Responsibilities:
- Write efficient, legible, and concise Python and SQL code
- Troubleshoot operational, system, and code issues
- Will work within the Scrum Framework and Agile methodologies
Requirements:
- Must have at least a Bachelor's degree in Computer Science; A Master's degree is a plus
- Should have 2 - 4 years of experience in system operations, development, or programming role
- Must demonstrate proficiency in Linux
- Must demonstrate proficiency in writing Python, SQL, and shell code
- Must demonstrate proficiency in SQL, knowledge of other database systems such as Mongo, Elastic, Redis, etc. is beneficial but not required
- Must have an understanding of networking components (e.g.: routers, firewalls, switches, balancers), network functions (switching, routing, forwarding, etc.), and the OSI model layers
- Must demonstrate understanding of APIs, functions and implementations (e.g.: REST/SOAP APIs)
- Should have an understanding of various data formats and containers (e.g.: JSON, Parquet, CSV)
- Should have an understanding of ETL pipelines
- Would ideally have knowledge of Python data libraries such as Pandas, DuckDb, Polars, etc. (extra points for ML libraries)
- Experience with administration of Grafana and creating dashboards within Grafana is a plus
- Knowledge of network, transport, and other protocols (i.e.: UDP/TCP/HTTP/TLS/DNS/LDAP) is a plus
- An understanding of distributed systems such as Spark or Dask is a plus
- Experience in messaging/pipeline tools (i.e.: Kafka, RabbitMQ) is a plus