↧
Answer by Vihit Shah for How do I calculate percentages over groups in spark?
Yes. You are right when you say that you need to use windowed analytical functions.Please find below the solutions to your queries.Hope it...
View ArticleAnswer by Vamsi Prabhala for How do I calculate percentages over groups in...
PySpark SQL solution.This can be done using sum as a window function defining 2 windows - one with a grouping on broker, fund and the other only on fund. from pyspark.sql import Windowfrom...
View ArticleHow do I calculate percentages over groups in spark?
I have data in the form:FUND|BROKER|QTYF1|B1|10F1|B1|50F1|B2|20F1|B3|20When I group it by FUND, and BROKER, I would like to calculate QTY as a percentage of the total at the group level. Like...
View Article