Timely dataflow

Still haven't quite figured out exactly what timely dataflow is (something like JIT-evaluated lazy streams that take advantage of parallel processing resources), but here's a paper to read.



Here's a Rust implementation of a similar system, with differential dataflow built on top of it.

Sieve watches pages and takes action on changes

Neat component.

Responding to excessive volume

A neat little discussion at StackOverflow (superuser) about how to take an action when the microphone volume goes too high, with some really fascinating responses, including one cobbling it together with Pure Data, an open source visual programming language I'd never heard of.  (It's a dataflow thing.)

Sirea

Wow!  Sirea is a Haskell framework for Reactive Demand Programming - tl;dr of that being "better Excel".  Kind of where I've wanted to go for years with dataflow programming, long before I got entangled with Decl.

But the Sirea project has immense amounts of ramifying thought behind it, to the extent that it must be made part of the Decl canon.

Declarative dataflow coding in the wild!

Wow!  The folks at Prismatic, who use Clojure to build newsfeed aggregators to spec, have developed a declarative dataflow graphing structure to describe their workflows - it's fab!

This is definitely going into Decl! I can't tell you how this resonates with what I am trying to approach.

Algorithms

More link dump.

The BK tree is a method of arranging trees of strings by similarity - probably not what TRADOS does, but something like it. Useful in future.

Modular Data Processing library for Python. There's no reason a Decl program couldn't write its own tools in Python, then either embed them using Inline or call them through the shell.

Parsing Techniques: A Practical Guide. Ebook of the old edition is free.

Speaking of NLP, the HBGary emails might provide grist for the mill.

Overview of text extraction algorithms, or a pointer to same; it's actually here.

Python generators for systems programmers

I need this in Class::Declarative! Wow! Also I need it in real life. Two birds!

Dataflow programming: Cascading

Cascading is a Java-based dataflow API for Hadoop. Since dataflow is one of the key declarative domains, as I see it, I want to do something more or less like Cascading's feature set.