Skip to main content

Posts

RDD commands

  Category Command Description / What It Does Example Creation sc.parallelize(data) Create RDD from a Python list rdd = sc.parallelize([1,2,3]) sc.textFile(path) Read text file (each line = 1 element) rdd = sc.textFile("data.txt") sc.wholeTextFiles(path) Read files as (filename, content) pairs rdd = sc.wholeTextFiles("folder/") Basic Transformations map(func) Apply function to each element rdd.map(lambda x: x*2) flatMap(func) Apply function & flatten result rdd.flatMap(lambda x: x.split(" ")) filter(func) Keep elements matching condition rdd.filter(lambda x: x>10) distinct() Remove duplicate elements rdd.distinct() union(rdd2) Combine two RDDs rdd1.union(rdd2) intersection(rdd2) Keep common elements rdd1.intersection(rdd2) subtract(rdd2) Elements in first RDD but not second rdd1.subtract(rdd2) cartesian(rdd2) All pairs between two RDDs rdd1.cartesian(rdd2) sample(withRepla...

Map Reduce

 /*******************************************************************************************  * BIG DATA LAB – 9  * Name  : 21MIS1029  * Topic : MapReduce Programs – Join Operations & Aggregations  *******************************************************************************************/ /*******************************************************************************************  * (i) MAP SIDE JOIN  * ------------------------------------------------------------------------------------------  * Q1. Develop a Map Reduce Program to display the details of employees using two text files  *     (sample code is given) using Map Side Join.  *  * Input:  *   empdetails.txt → (emp_id, emp_name)  *   empdata.txt    → (emp_id, salary, dept_id)  *  * Output:  *   emp_id, salary, dept_id, emp_name  ****************************************************...

Map Side Join

package my.org; import java.io.*; import java.util.*; import org.apache.hadoop.fs.Path; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.io.*; import org.apache.hadoop.filecache.DistributedCache;   // Deprecated in newer versions, but fine for Hadoop 1.x import org.apache.hadoop.mapreduce.*; import org.apache.hadoop.mapreduce.Mapper.Context; import org.apache.hadoop.mapreduce.lib.input.*; import org.apache.hadoop.mapreduce.lib.output.*; import org.apache.hadoop.util.Tool; import org.apache.hadoop.util.ToolRunner; public class mapsid1036 {     // ---------------- Mapper Class ----------------     public static class Map extends Mapper<LongWritable, Text, Text, Text> {         private ArrayList<String> employees = new ArrayList<String>();         // Setup method loads data from Distributed Cache         @Override         public void setup(Con...

Reducer Side Join

package my.org; import java.io.IOException; import org.apache.hadoop.fs.Path; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.io.LongWritable; import org.apache.hadoop.io.Text; import org.apache.hadoop.mapreduce.Job; import org.apache.hadoop.mapreduce.Mapper; import org.apache.hadoop.mapreduce.Reducer; import org.apache.hadoop.mapreduce.lib.input.MultipleInputs; import org.apache.hadoop.mapreduce.lib.input.TextInputFormat; import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat; public class redjoin1036 {     // -------------------- CUSTOMER MAPPER --------------------     public static class CustMapper extends Mapper<LongWritable, Text, Text, Text> {         public void map(LongWritable key, Text value, Context context)                 throws IOException, InterruptedException {             String[] line = value.toString().split(",");   ...

The Final: gameplay detail, system requirements, release date, early access.

The Final is the upcoming AAA free to play game, and here is all you need to know about the game.  The final is a new competitive FPS shooter game with destructive environment. Here is everything about the release date, gameplay details, system requirements and how you can get closed beta access.  The game is made and published by Embark studio which is there first game as a studio by the developers are ex dice studio employees and have worked in battlefield . So you can definitely expect a high refined game .  On the first look it looks like a mixture of gta online and csgo with a lot of caos and destruction. The game graphics looks absolutely stunning like upgraded gta 5. The game is not a battle Royal or a arena shooter. In the game you most probably have to complete objective by stealing coin. The game main theme is still not fully revealed.  The Final game Release date.    The game will most probably be out in September or Novem...

Valorant new agent gekko ability explained

So there are few images of gekko has been leaked from facebook which shows us all his ability and you won't believe how amazing and over powered they are and specially his ultimate.  By the way if you don’t know gekko is a initiator. And can control animal like creature. In his first ability we can clearly see him controlling a creature while closing his eyes with his hand.   This ability would be used to scout a area like sova drone or syeke’s dog and will also stun enemies near to it. And it will also be faster than the Skye’s dog basically its Syke’s dog not much difference. This second ability would be like a slimy grenade which would slow down enemies like sage slow orb. There is also a probability that this will also reveal enemies because why not if its a initiator. So now this ability looks interesting . It looks like this creature could defuse and plant t...

XDefiant the next free to play game like COD

XDefiant is a first-person shooter game that is currently in development by Ubisoft.  The game is set to be a free-to-play, multiplayer shooter that features various factions, each with their unique abilities and playstyles. The game is set in a world where factions of rebels, outcasts, and other misfits come together to battle it out in various game modes. The game is being developed by Ubisoft San Francisco and is expected to be released on PC, consoles, and cloud gaming platforms. XDefiant will feature a range of different game modes, including Domination, Escort, and Arena. It will also include a robust character customization system, allowing players to create their characters and personalize their playstyles. Ubisoft has not announced an official release date for XDefiant yet, but they have stated that the game will be available soon. Interested players can sign up for the game's beta on the official XDefiant website.    Even though currently no release date is ...

All we know about counter strike 2 with leaks

All the leaks about csgo2  Ok since a couple of hours there is a huge buzz on Twitter about cs 2 but you the surprising thing to know is that it is not just a everyday twitter trend.  So Nvidia drivers introduced support for 'cs2' in there latest updateand that's all the fuzz about it. They even deleted it after some time. Most probably it was a smsll mistake which they even corrected and who said the ' cs2' means counter strike 2 it could be 'China secret mission 2' i know m is not there but why not.  But still we all can be hopeful about cs2 . There are lot less skin released this year in csgo which directly effects valve revenue. Valve has also not released a game since a long time and valorant has also emerged as csgo rival taking a huge chunk of csgo playes. Because of all these reasons it would be a perfect time to start working on a new game which would bring back there lost legacy. 

Valorant new agent gekko leaked with photo.

So riot has revealed the next agent would be an initiator and will be fully revealed in the grand finale of LOCK IN. Only few days are left but we didn't got any type of information in the range which we usually get but as per leaks  its name would be gikko, which is most probably related to the animal or l should say the side kick of the agent.    This side kick would gather information because what else even initiators do other than spamming of the revealed area. Man Riot is seriously out of any ideas. At this point they are now even able to copy overwatch. But we can still hope that it will have something different from skye and fade and not just a copy paste.  By the way here is the leaked photo of agent as a gift. 100℅ real 

Valorant mobile release date (2023) ?

Its been more than a year since the valorant mobile has been announced but we still didn't  got any released date for the game. The latest dev video told us that there development on the game had gone slow and the game will not come soon. Which confirms us that we should expect the to come in 2023 . It would most probably come in late 2024. Even though some images of valorant mobile in Chinese had been leaked showing us that testing the game had already started but the dev told as if the game is not even half done, this can may be because they have now decided to change the base of the game, that they may have started the game as an battle Royal but not seeing the decline of battle Royal they have changed the decision.  Valorant mobile wouldn't be just a copy paste of the pc version as the about of abilities of a agent is difficult to use in mobile screen and this is specialy true for a agent like jett and reyna who needs to be fast if there abilities. 

Valorant is dead ?

 Its  have been almost 3 years since valorant has been released and we have started to see its down fall, its not dead or near dead but the impact is visible. Players are leaving the game and trying newly released game like overwatch 2.  We don't have any data of player base but the people involved in the community are declining. And main reason is not any rival game but is covid. Since the lockdown has ended people have got other things to do and now have less time to spend on games. Most of the casual players played valorant because of its release time, it was just perfect, it released just when the lockdown started resulting in a boom in player base but now as the lockdown is ended they have to see the most down fall in player count.  Another reason is that already existing games like csgo has made their comeback by releasing great updates which valorant couldn't do, when valorant released csgo was in a bad conditions even valve was also not paying mu...

What is valorant night market?

 Night market is back. If you are new to valorant and don't know what is night market, it is basically a valorant shop where random gun or knife skin comes for cheap price than normal, about 40 to 60℅ discount because of which people just wait for night market and only buy skin from there.So yaa a another of trying you to spend your money on the game. But why players talk about this so much ? It is because the world random.  Every player gets totally different set of guns and on top of it the layout is made like a card game which makes it look like a game of luck, you can compare it with box opening in csgo. Even though it does not give same adrenaline rush as in box opening but still it is some what like it.  Another great or not so great thing about night market is that you can get great skin like prime or oni for very cheap price or you can get all the trash skin in your market showing not just your bank balance but luck is also in a very bad state . So peo...

What is valorant premier mode.

What is valorant premier mode.  In the latest dev's video revealed they are working on a tournament mode named premier, they have also started testing it. The global beta will launch in EP6 ACT3 (few days left) according to leaks .  This system is really good for a compative game like valorant. And i think it wouldn't be just for the top 1℅ players but also for the lower elo . But many think it will be like in league where a whole server is dedicated to pro. It can happen either way but probability to riot including lower ellos even iron in valorant is high as they want the game to target all the audience.  There could be a tournament every weekend or so for every ello and players should be of some level to participate in it but the entry would be free and the winning team would get reward like spary and buddy or pistol skin but they definitely won't give a gun skin as there whole revenue comes the skins only, they're gonna give them for free, but all these ...

Valorant new game mode team Deathmatch

In the latest video by dev announced us about new game mode team death matches and seeing how they revealed about shows that it will very soon most probably in next act. They also said that it would be there take on the team death matche which clearly tells us that there would be abilities evolved and even ultimates will be there but the way of getting them would be different. I know dev would do it right and the players will love it but for few weeks only.  No game mode other than the main game mode can beat replication and even being the best no one really plays or is into it, players were exited for few weeks but then its just there which players play sometimes. Valorant is a compative game and is designed like that so a too casual game mode cannot give a long time boost to the game. 

Will there be a Valorant Netflix web series?

  Arcane which is Netflix show based on league of legends game which is developed by riot the same come which developed valorant, both the game fans and the normal audience loved the show. This show benefited both Netflix and riot so there is no reason why they will not collaborate again for a game like valorant which has a such a large amount of fan base already there .Even though there currently no news about the development of the show , but this would eventually happen.   Like many other character based game Valorant also releases some in every patch . Even though all we know about the Valorant world is the there is some kind of element named radianite which is extremely rare and powerful , you can compare it to titranium in marvel universe. And the other thing we kno is there are  two worlds or two earths which somehow got splited and in one world no radianite is left any more so they are going to another world or earth to steal it and that’s the bas...

Best agents on Valorant lotus map

Its been more than a week since the new valorant map lotus has been released. Even though it was just for a week we have got enough knowledge about the play style on this map. So here we are with the best agents which can help you with winning you   matches on lotus map.      1.Reyna Like many other maps she is great in this also. She is best for aggressive at B site and clearing the angles. And as the map is pretty open and you  also may need to rotate a lot which will makes raze and jett not an effective pick on this map. And as this is a one dualist map and your team should pick two sentinal, Reyna becames the best and only dualist you should pick.  2.Killjoy She was already in meta after chamber got huge nerf, but don't you worry as killjoy has got your back, She can single handedly control a site and even two site if needed. She definitely can stop a whole team push but will damage there team a lot and will make them vulnerable and thi...