Hive中如何强制UDF在Reducer执行

转载自:http://kernel-panik.blogspot.com/2013/05/force-udf-execution-to-happen-in-hive.html

Doing quick and dirty URL fetch from hive, I wanted for URL”s to be ditributed among 5 jobs. Input is small it’s very hard to tune up on mapper side things to heppen on 5 mappers say.

Regular:

Forced UDF execution to Reducer (5 reducers):

Leave a Reply

Your email address will not be published.