Page 1 of 1

What's your data pipeline setup?

Posted: Tue Aug 29, 2017 8:02 pm
by Rd11490
Since its the offseason and this forum has been a little empty recently I figured I'd ask about what everyone uses for their data pipeline.

What language do you code in (or do you use excel/some other tool)?
Do you store data in a DB? If so which do you use, if not how do you persist data?
How much of your process is automated?
Do you do your work locally or in the cloud (aws/azure/etc)
Any special tools/libraries?
Anything else of note in how you work?