[ad_1] I think that you should build Hive Datawarehouse using Hive or MongoDB Datawarehouse using MongoDB. I didn’t understand how you are going to mix them, but I will try to answer the question anyway. Usually, you configure for a BI tool a JDBC driver for DB of your choice (e.g. Hive) and the BI … Read more
Introduction [ad_1] Business intelligence (BI) is a critical tool for organizations to gain insights into their data and make informed decisions. Spark is an open-source distributed computing platform that has become increasingly popular for its ability to process large amounts of data quickly and efficiently. Spark is a powerful tool for business intelligence, as it … Read more
[ad_1] How to perform self join with same row of previous group(month) to bring in additional columns with different expressions in Pyspark [ad_2] solved How to perform self join with same row of previous group(month) to bring in additional columns with different expressions in Pyspark
[ad_1] file = open(‘a.txt’, ‘r’) l = [] for line in file: l.append( line.split()) Then if you want the second part to be integer, you can use list comprehension: l = [ [i[0], int(float(i[1]))] for i in l] output [[‘abcd.com’, 0], [‘*’, 66999306], [‘asdf.com’, 150744025], [‘asfd.df.com’, 193139033], [‘fdsa.com’, 907938122], [‘bank.com’, 2638989462], [‘fire.com’, 4151822166], [‘ms.com’, 7026079907] … Read more
[ad_1] You are getting duplicates due to join, you can get expected results without join. Try below query select materialno, sum(billedqty), min(materialdesc), min(startdate) from billing group by materialno; When you are joining test1 with billing table, you are getting duplicates because your materialno=”1001″ is having 2 corresponding “materialdesc” values, and “startdate” values. But the query … Read more