We are working in partnership with a Start-up Artificial Intelligence business based in London. This business is looking to change the way news is validated and reported across the world.
As part of recent and continued business expansion, they are growing the Data team with the addition of a Data Engineer. This is a permanent role and is key to the success of this business moving forward. The role is to work alongside a team of world-class Data Science specialists in Artificial Intelligence and as the Lead Data Engineer, you will drive the strategy for data collection and ingestion into the business, so their AI product can be trained.
This position would suit a back-mid software engineer as although you will play a major part in designing the training dataset, you will also be required to martial the flow, there are many AWS Lambdas running concurrently to chomp through the data and it needs to be auditable throughout the process.
Core responsibilities of the role:
Assist the team in the design of the Data ingestion and collection strategy
Design & build, secured and operated data collection (Python/AWS), both at scale and at high-quality.
Be responsible for setting and ensuring data quality standards are met and maintained
Driving automation across the business to minimise manual work and input
The Successful candidate will have:
Degree in Computer Science (or related field).
Strong knowledge (with hands-on experience) of Python
Scaling data service on AWS (at medium to large scale),
Securing applications/data in general, and in AWS specifically.
Able to manage the annotation team of 4 part-time remote-working linguists.
Understand global privacy regulatory frameworks (e.g. GDPR).
Experienced in defining IT development strategy/roadmaps and delivering them.
Knowledge of social networks and their data.
For more information on this role please feel free to contact me on 07375 497 383 or [email protected]