Data Engineer
Austin, Texas
About Andrew
As a Big Data Engineer with experience at KPMG and Hedgeye Risk Management, I've developed a range of skills that include designing and implementing data pipelines, building infrastructure as code, and utilizing natural language processing techniques. I've worked on diverse projects involving ETL pipelines, OCR, and data quality checks. My expertise in PySpark, Scala, and Spark SQL has allowed me to create custom modules that enhance the efficiency of data pipelines, and I have experience working with various cloud technologies such as Azure, Docker, and Kubernetes. I also have experience with web scraping and automation. In addition, I hold a degree in Data Science and am always eager to learn new skills and take on new challenges.