hadoop - Inserting from Kafka to Cassandra using NIFI -


i have requirement read huge csv file kafka topic cassandra. configured apache nifi achieve same.

flow:

user not have control on nifi setup. specifies url csv located. web application writes url kafka topic. nifi fetches file , inserts cassandra.

how know nifi has inserted rows csv file cassandra? need let user know inserting done.

any appreciated.

i found solution.

using mergecontent processor, flowfiles same value "fragment.identifier" grouped together. once mergecontent has defragmented them, can notify user.


Comments