On 3: I dont see why you would need to do that in the source plugins. Simply create an attribute named extra_metadata = {field1: val1, field2 : val2, ...}
Do some kind of merging on extra_metadata for results from all sources. Return a result that contains extra_metadata from the identify function. Leave it up to the consumer of the result to map the data from fields to custom cols.
|