http://robertheaton.com/2015/08/31/migrating-bajillions-of-database-records-at-stripe/
I like reading these types of stories about how the sausage is made.
NATS: Open source, high-performance, lightweight messaging system written in Go
Vega: Declarative (JSON) format for creating, saving, and sharing visualization designs using HTML5, Canvas or SVG
Mithril: Fast, lightweight JavaScript MVC framework
Flarum: Open source forum software, PHP/MySQL backend, JavaScript client-side
gitfs: Version controlled file system where changes are automatically committed
Flying Saucer: Java XML/XHTML rendering library that uses CSS 2.1 to output Swing panels, PDF, & images
git-radar: Tool that changes command-line prompt to show git repository status
Writ: Classless styles for semantic HTML and modern browsers
CSVfix: Windows/UNIX command-line tool for dealing with CSV data
http://neilb.bitbucket.org/csvfix/ ᔥ
CSVfix is a command-line tool specifically designed to deal with CSV data. With it you can, among other things:
- Reorder, remove, split and merge fields
- Convert case, trim leading & trailing spaces
- Search for specific content using regular expressions
- Filter out duplicate data or data on exclusion lists
- Enrich with data from other sources
- Add sequence numbers and file source information
- Split large CSV files into smaller files based on field contents
- Perform arithmetic calculations on individual fields
- Validate CSV data against a collection of validation rules
- Convert between CSV and fixed format, XML, SQL and DSV