Comments on: Hive中的TRANSFORM：使用脚本完成Map/Reduce。 https://www.coder4.com/archives/4052 Keep It Simple and Stupid Thu, 11 Apr 2019 08:28:46 +0000 hourly 1 https://wordpress.org/?v=6.8.3 By: cuilaixi https://www.coder4.com/archives/4052#comment-1402 Thu, 11 Apr 2019 08:28:46 +0000 http://www.coder4.com/?p=4052#comment-1402 #!/usr/bin/python

import sys
import hashlib

for line in sys.stdin:
line = line.strip()
arr = line.split()
md5_arr = []
for a in arr:
md5_arr.append(a)
md5_arr.append(' ')
md5_arr.append(hashlib.md5(a).hexdigest())
print('\t'.join(md5_arr))

# hive>add file md5.py
# select transform(id,name) using './md5.py' from t_task;

]]> By: linou https://www.coder4.com/archives/4052#comment-1255 Wed, 16 Jul 2014 01:40:09 +0000 http://www.coder4.com/?p=4052#comment-1255 SELECT
TRANSFORM (col1, col2)
USING './test.py'
AS (new1, new2)
FORM
test;

 

FORM-->FROM

]]>