Jeff Zhang
Sep 25, 2023

--

Thanks for the sharing, this should be useful in some scenarios (like EL, or EL with simple T), but I don't think it is suitable for the scenario which has complex transformation logic. For the complex transformation logic case, it is more straightforward to use spark sql or using scala/python api. Json representation is kind of another DLS of spark api.

--

--

Jeff Zhang
Jeff Zhang

Written by Jeff Zhang

Apache Member, Open source veteran, Big Data, Data Science,

No responses yet