The benefits of certifying IBM Spectrum Scale with the Hortonworks Data Platform by Par Hettinga

So what is IBM launching with Hortonworks in 2Q 2017? We are certifying IBM Spectrum Scale with the Hortonworks Data Platform. We certified IBM Power Systems for the Compute part of HDP in April 2017. What we are now certifying is that the Hortonworks Data Platform can run Spectrum Scale as the Storage layer instead of the default Hadoop Distributed Filesystem, on both Power Systems and x86 using the Spectrum Scale Transparent HDFS Connector. Since this certification is for the Spectrum Scale software, it applies to both the software only version of Spectrum Scale and our integrated appliance called Elastic Storage Server that runs on 2 Power Servers with the Spectrum Scale software and storage hardware in a single node. The main client benefit for running Hortonworks HDP with IBM Spectrum Scale instead of HDFS is the big cost savings resulting from the reduction in the data footprint at the customer site and the ability to do in-place analytics. What happens with the Hadoop Distributed File System in a traditional application environment is that data is stored in multiple NAS boxes and you have to move the data from these NAS filers to the Hadoop Distributed Filesystem before you can run your Hadoop analytics and when this is completed, you will need to move the results back to your NAS filers. As the amount of data that needs to be analyzed grows into the multi Terabyte and Petabyte range, the moving of data from the NAS filers to HDFS becomes not only cumbersome but a very time consuming process potentially taking many hours or even days resulting in stale data being used to generate results because of the long copy process. Because IBM Spectrum Scale supports multiple Storage protocols like POSIX, NFS, SMB/CIFS, iSCSI plus SWIFT and S3 for Object Storage, we are able to build a huge Data Lake and run in-place analytics without the need to copy data as in a typical Hadoop HDFS workflow. What happens is that the applications can store the data in the Spectrum Scale filesystem which is the same place the Hadoop analytics jobs are performed, because now data can be accessed using the Spectrum Scale Transparent HDFS Connector. The second major client benefit is that HDFS normally does a default 3 way replication for data protection and performance. So if you have 5 PBs of data, with a 3 way replication you will need 15PB of storage. Using the IBM Elastic Storage Server running IBM Power Servers and Spectrum Scale software, plus GPFS Native Software RAID you eliminate the need for 3 way replication. So for 5PBs of data you will only need 6.5 PB of Storage. So a cost saving in Storage capacity of more than 40%. In summary, eliminating the need to move data from NAS filers to HDFS, and reducing the amount of storage needed for running Hortonworks HDP, provide compelling reasons for clients to move to an IBM Spectrum Scale or Elastic Storage Server based analytics solution. To get more information on this offering please visit the IBM Spectrum Scale Website.

MSP Databalance Case Study: Business decisions in real time based on fast data-driven Analytics

In our modern datacenters, we prefer IBM infrastructure. For our environment we have a mixed platform from Intel, Linux, Power i and AIX.
For this we use the various IBM Power P, Power i and Intel servers. All these systems are linked using the capabilities of the IBM San Volume Controller, FlashSystem V840 and V7000. As central storage solutions we use the V3700, V7000 and V840 storage systems, because of their excellent speed, reliability and low operating costs. The San Volume Controller is used to easy tier, real time compression and mirroring. With these standard techniques present at our systems we are redundant and thus high available. To insure continuity, we are using Tivoli Storage Manager software on most platforms, fully integrated with our SVC solutions. Together with IBM we can offer all possible cloud solutions for our customers, IAAS, PAAS, SAAS. The SAP platform used by Beeztees is hosted by Databalance Services. Databalance advised Beeztees to put the database servers on IBM Flash Storage. This IBM V840 Flash Storage delivers more than 400 thousand IOP’ s. The other servers have been placed on Easy Tier Storage, resulting in an optimal mix of speed and capacity. In practice the generation of reports, lookup jobs and batches are processed much faster. Databalance is a key partner of Beeztees in the field of automation. Throughout the whole migration Databalance has been involved and has advised and supported us. The result of the last months is a very modern and “state of the art” ERP platform based on SAP software and IBM hardware, which enables Beeztees to stay a few steps ahead of the competition. IBM Spectrum is based on software-defined storage and it enables users to obtain increased business benefits from their current storage products whether from IBM or another vendor. IBM has pioneered in this field since 2003 and supports more than 265 storage systems from several brands. This give you more value from earlier storage investments. Databalance is making use of the IBM Spectrum family in serving its clients. The IBM Spectrum Virtualize is a giving maximum flexibility and reliability by virtualizing the storage. You can also get more benefits by using features like Real Time Compression and Easy Tier. And of course you can create a disaster recovery environment by implementing remote mirroring. With IBM Spectrum Protect you enable a reliable, efficient data protection and resiliency for software defined, virtual, physical and cloud environments.

Ubiquity to enable IBM Spectrum Storage in Containers (Docker & Kubernetes) by Robert Haas

As the CTO for Storage Europe in my previous update I had mentioned I had mentioned that we intended to deliver a way to integrate our Storage in container environments such as Docker Swarm and Kubernetes. Well, this is now a reality, and it is called Ubiquity, thanks to the hard work of a team involving our Research and Development labs across the world. Ubiquity is available as open source, in experimental status at this time. Let me briefly explain here where we see the adoption of containers, and what is this Ubiquity technology enabling in a bit more detail. Many surveys are showing that the adoption of containers, and more specifically Docker, is accelerating, also in the enterprise environments. You may have noticed the announcements by many large companies intending to adopt container for most of their infrastructure. This covers many use-cases, such as traditional applications, HPC, cloud, and devops, for instance. In HPC, the portability of containers ensures that a workload can go from the testing laptop of a scientist to the big supercomputer without changes, that is from quality assurance, to staging, to production, with the same code. In a cloud environment, whether on-premise or not, containers are attractive because they deliver the best resource utilization and scalability, with the smallest footprint and the highest agility. Finally, for devops, containers simplify and accelerate application deployment through the reuse of components specified as dependencies, encouraging a micro-service architecture strategy. In summary, containers are a standard way to package applications and all its dependencies; they are portable between environments without changes; they isolate unique elements to enable a standardized infrastructure; all of that in a fast and lightweight fashion. Now, with the adoption of containers increasing beyond just stateless things such as a load balancer or a web application server, there is a need to provide support for persistent storage, that is, storage that remains after containers stop, so that data sets can be shared, so that the output of analysis can be retrieved by other processes, and so on and so forth. For many adopters of container technology, the persistent storage and data management are seen as the top pain points, hence storage vendors have started to support ways to enable their products in the Docker and the Kubernetes container environments using what is called plug-ins. With the technology we call Ubiquity, because it is targeted to support all of the IBM Storage, in all of the types of container environments, we have now released this ability as well. As I said, it is available at the moment in experimental status, so we’re welcoming feedback, and you can download it as open-source from the public github. In a nutshell, Ubiquity is the universal plug-in for all of IBM Storage. With this plug-in, and the underlying framework, storage can be provisioned, and mounted directly by the containerized applications, without manual interventions. This is key to enable the agility in an end-to-end fashion. This allows you to take advantage, for instance, of our Data Ocean technology such as Spectrum Scale in container environments. This way, you can also take advantage of the unique capabilities of Scale, in terms of performance, scalability, and information lifecycle management. And you can also seamlessly integrate our block storage such as Storwize. We are convinced that containers are going to play a role as important as VMs, if not more. Containers are already the norm in the IBM Bluemix offerings, and have been adopted by our Power and Z products. With Ubiquity we’re now able to close the loop with Storage. We’re collaborating with a number of clients testing Ubiquity already now, so that we can develop this technology to match our clients’ needs. Among many other things, we intend to adapt Ubiquity to the rapid changes occurring in the container frameworks such as the CSI (for Container Storage Interface), currently worked on by the Cloud Native Computing Foundation’s (CNCF) storage working group. To conclude, with this you will get the best of new generation applications with the performance and enterprise support of IBM Storage.

Building An EPIC Human Heart on Build Battle!

yoga's what is that my name is juror croft and welcome to another minecraft video i hope you're having a fantastic day we are taking a break from all the massive build projects and you guys know who relax take it easy and play a few more rounds of build battle now it looks like for this first round we got to build ourselves a windmill which is just great cuz you guys know i can easily put together any kind of building just don't tell me to build a whale or a donkey you guys know i struggle with those things it's never a good idea so let's just see how things go let's also throw in some grass while we're at it you guys know it makes everything look so much better i just don't plan on building anything too crazy because at the end of the day we only have 5 minutes and you guys know i get carried away with these minecraft projects so let's just go for simplicity for this round i think we did pretty good in the last episode winning two of three rounds we scored a decent win through the fire ball striking down on that building and we also scored a win with a smaller version of the epic style nether portal which was just great by the way i have two really cool video ideas coming up so don't miss out subscribe and stay tuned but if you guys have some really cool ideas yourself feel free to dish them out in the comments below so pretty much going for a simple design here nothing crazy 5×5 windmill using some ster blocks for added shapes and details we'll see how it goes at the end of the day we don't really know how good we've done until we see what other players have built let's throw in a walkway as well get a spruce wood door in there actually I think I should have added the path first yeah let's do that with some cobblestone then add in the door and then we can add some friends to you know add some extras I suppose again nothing too crazy so just about three minutes left on the clock I think we're pretty much good for time so I'm just going to make this slightly taller and then of course we can add in some blades I just use some white will I suppose standard design just going to make sure that every single blade is the same size if not it's just going to look extremely extremely wonky so that's looking pretty good I'm quite happy with this design so far I guess we can add in some extras see how much time we have left we have about a minute and a half so I guess I'll just add a top piece and we have that done I guess I don't know what else to do to be honest I feel like something's missing though let's try adding a button right in censors that is that better I don't know guys I feel like it's okay but it's just missing something that's going to give it that extra boost so let's try adding some okra defense on top of the we'll see how that looks we have about a less than a minute left so this this is make it or break here right now well honestly I don't know what to make of this really I mean it is a windmill so that's a plus but I'm pretty sure someone's built something better so let's take a look at what other people are built and let's jump onto the voting stages whoa whoa no way that is the best-looking windmill I have ever seen in my life we have definitely lost this round I mean did you see the detail on that windmill the eyes the red wool it all came together like mad this is we don't stand a chance we just don't stand a chance on a serious side note though I mean what was he thinking you're supposed to build a windmill and it just goes then you know what let's build a crab why not anyway this is okay I mean I think it's missing the blades we're doing pretty good I think we have a chance of winning now I'm usually quite strict with the voting but I'm being generous I'm going to go okay and good with practically every single build here's mine and you know what I'm not even going to talk at this point because I clearly underestimate my bills are you serious is it really that good we just done a complete overkill legendary you know I still think the crab was better the crab was so much better no but seriously I didn't expect the legendary that's mad I'm gonna go okay with that and I think I'll just go okay with this as well why not this one's actually pretty good considering we only had five minutes this on the other hand I don't even know what that is and I'm gonna stop being generous at this point I mean let's face it it was kind of obvious at this age so let's jump on to round 2 now this is where we have a serious problem we have five minutes to build ourselves an egg like seriously what what am I supposed to do at the end of the day it is just an egg there's only so much you can do I'm going to be using some white stained clay seeing as that kind of resembles the color of an egg I'm going to change the floor though to grass seeing as the egg is the same color as the floor I wonder what other players are doing though like when is that I don't know guys I don't know what else to do to be honest like I'm literally running out of ideas this is just an egg look at it okay seeing as we have more than three minutes on the clock I need to find a way to make this more interesting so I've decided to build a giant spoon kind of like an egg race you know it is Easter after all wait is that even an Easter thing is the egg and spoon race and Easter thing I have no idea nevertheless we're going to build a giant spoon and that ends off right so let's finish off the giant handle right here using some stone I don't even know if stones a good idea but that actually looks pretty decent and I have a great idea for the back of the spoon we can go for a bit of a spiral effect I don't know how this is going to turn out but maybe we can touch it up with some cobblestone later on right now I think we have a good idea I mean this is this is great look at it it actually doesn't look too bad I just need to add some extra detail you know what guys I'm just come up with a great idea we have two minutes left on the clock and how about we crack the egg and fill it up with some egg yolk using some orange wool I think this is actually going to make the egg look so much better look at it we can have some actually egg yolk you know spilling off the side of the spoon why not I just need to kind of figure out what looks best and that is about good I mean we got one minute left and I think we can just add in some extra cobblestone to the spoon just to add a bit more curvature and detail but for now I think I'm really happy with this design I think we have a good chance of winning I don't know every time I think I'm going to win I end up losing and when I think I'm going to lose I end up winning and gaining a like a legendary build overkill so I don't know guys I don't know how this is going to turn out we have five seconds left on the clock two one and that's about it guys we're down to the voting stages and Wow yes definitely not a crab this time we have a frying pan and an egg I'm going to go good on that one I did not actually think of that one what is going on here though I have no idea what this is I'm sorry I just don't get it what is this what is this it's a Laker oh it's all I rated it a poop and I think it was actually it was actually two dragons hatching from an egg I was actually a good idea and this one's okay – so why not guys check this out I don't even know what to say it's actually quite good but it's also kind of disgusting at the same time how do they come up with these ideas it's like yeah let me just build an egg and use slime blocks for boogies I mean I don't know how do you come up with these ideas this one though it's absolutely amazing look at this it's amazing this guy on the other hand he's gone quite crazy really wanted to add effect through his egg he's got a road chickens lined up flapping their wings it's mad oh no here we go again it's another crab I can't stand this I can't look this what what makes you think that building a toilet in an eggs competition is gonna is gonna win this is crazy if that wins I give up I give up I literally I walk away right now this is an okay why not this is probably an okay as well I don't know what's going on here though like what are those are those like mini creatures look what is this and here's the moment of truth gerrae croft mighty egg on a spoon I don't know what to say guys I don't see many people voting I actually saw quite a few red blocks this could be a disaster was it really that bad I don't know I'll let you guys decide in the comments what you think of my bills anyway but um oh this guy's even built a chicken this guy's gone the extra mile right guys I don't even know what to say at this point this is mad this is mad I don't know if you guys noticed but we actually scored sixth place so I guess they must have thought my build was a crab I don't know it is clearly what made me lose they must have thought my build with the crab that's fine I accept losing it's fine we have a heart to build now again five minutes and I plan on building a working human heart at least that's the idea I mean I could always just go for a simple heart design like a cartoon kind of style but I really want to go the extra mile for this last build and I'm even going to use some purple stained clay to actually create the veins I'm not a doctor but I know what a human heart looks like at least I've seen it in pictures what's really taking me forever to put together all these red stains clay blocks which are going to initially make this of the heart and it is kind of a tricky shape to put together so I really really don't know what this is going to turn out to be I mean right now it looks kind of decent so I'm quite happy with it so far but we're going to have to find a way to add some extra detail I know that the rest of the players are going to go for a kind of cartoon style heart at least that's what I'm expecting so we do need to stand out from the crowd and build something a bit more epic right guys we have just about 1 minute and 30 seconds left on the clock I've spent a lot of time trying to get this shape as perfect as possible but we're going to have to add some extra detail so I've just come up with an idea and maybe using some red stained glass and even some lava will make this look a lot better again I don't know this is going to work but the lava could kind of represent I don't know flowing blood maybe do you think this is a good idea I don't know we got one lit left but I kind of gives it something extra to look at so I'm just going to go for it I'm going to risk it for a biscuit and hope for the best we just need to find out what everyone else has put together right so we have 10 seconds left on the clock and overall I'm quite happy with the style of the bills I mean it's kind of unique it's not your average cartoon style anime art hot oh wow that's a great way to explain it but anyway you guys know what I mean this is what I expected a kind of simple flat surface kind of hot so hopefully they'll find my bills to be a bit more interesting and will score some high points we'll just have to see how it goes guys I feel like I'm being hacked right now yep I can't move like seriously I can't move the keyboard is not working guys I cannot even vote okay look just promise me you won't laugh okay just don't laugh at me please please okay I think past the fact that I was being hacked okay my keyboard wasn't properly plugged in but here's my build here we go let's see how it goes guys hopefully we might even score another legendary I do see some yellow blocks oh yes we actually did it twice in a single episode so there you go at least my plan worked out and the human heart actually worked out I don't know what's going on over here but apparently we got a bunch of villages on top of whoa this looks like a nike tick this is the kind of nike thick you would see on your shoes maybe in a fake brand but okay whatever this one actually has gone forth kind of style that I kind of went for just a bit more different I don't know it does kind of look like a heart so I guess I'll vote okay on that one – and this guy has even stabbed his heart with a giant arrow why not and this build is actually my favorite I love the choice of colors he's built a rainbow heart I'm gonna go okay I'm gonna go good sorry I'm gonna go good with that one but clearly we still won this round guys thank you for watching today's episode I hope you guys enjoyed it and if you do want some more build battle let me know in the comments below this is Jared Ross over and out give it up