Welcome!

Log Management Authors: Dana Gardner, Pat Romanski, Elizabeth White, David H Deans, Carmen Gonzalez

Related Topics: @DXWorldExpo, Log Management, Apache

@DXWorldExpo: Blog Post

HP Doubles Down on Big Data Effort By @Dana_Gardner | @BigDataExpo #BigData

HP pursues Big Data opportunity with updated products, services, developer program

HP today at its Big Data Conference in Boston unveiled a series of new products, services, and programs designed to help organizations better leverage data and analytics.

The company announced:

  • A new release of HP Vertica, called Excavator, that feature data streaming and advanced log file text search to power high-speed analytics on Internet of Things (IoT) data.
  • Broader support for and contributions to open source technologies, including optimized Hadoop performance, integration with the Apache Kafka distributed messaging system, and advancements in Distributed R predictive analytics.
  • The HP Haven Startup Accelerator program, which provides early-stage companies with fast, affordable access to both HP Big Data and Application Delivery Management software and services.

"Big data helps us make more sense of it all, a byproduct of what we do everyday," said Robert Youngjohns, Executive Vice President and General Manager at HP Software, in a keynote address. "Big data solves everyday problems like security, inventory, and empowers workers ... and you can now exploit 100 percent of your data."

Youngjohns said that HP at its HP Protect show in a few weeks will announce how to better mine IT systems analytics to make enterprises more secure.

"Big data changes the game in the idea economy," said Colin Mahony, Senior Vice President and General Manager of Big Data at HP. "Big data is core to all apps, but customized composite analytic applications are coming."

The key question for enterprises is, how can you embed analytics into the role you play in your organization?, said Mahony, adding that, enterprises need to spin up new apps constantly to identify and analyze via context, which they cannot get from packaged apps.

"Developers are the new heroes of the idea economy," said Mahony. "Through our Haven and Haven OnDemand platforms, we are empowering these heroes to transform their business through data, by allowing them to harness the value of all forms of information, rapidly connect and apply open source, and quickly access the tools they need to build winning businesses." [Disclosure: HP Enterprise is a sponsor of BriefingsDirect podcasts.]

Also addressing the keynote audience was recent Turing Award winner Mike Stonebraker, CTO and co-founder of Tamr. He said that the development of the column store database was the most disruptive thing I ever did. "It transformed the market," he said, and lead to the Vertica big data platform that HP acquired in 2011.

But he cautioned against getting caught up in marketing buzz over data science substance. "I’ve been doing big data forever. The buzzword is meaningless, it’s about solving data volume, velocity, and variety problems."

"Analytics is moving to complex analytics, using machine learning and statistics, so you need to get smart at data science," said Stonebraker.

'Excavator'

Capabilities in the new version of Vertica, codenamed "Excavator," include:

  • Data-streaming analytics offering native support for the Apache Kafka open-source distributed messaging system to enable organizations to quickly ingest and analyze high-speed streaming data, including IoT, in near real time. This capability delivers actionable insight for a wide range of use cases, including manufacturing process control, supply-chain optimization, healthcare monitoring, financial risk management, and fraud detection.
  • Advanced machine log text search to enable organizations to collect and index large log file data sets generated by systems and business applications, helping IT organizations quickly identify and predict application failures and cyber-attacks, and investigate authorized and unauthorized access.

HP also released a series of solutions designed to enable organizations to combine the innovation of open source with the enterprise-scale, reliability, and security. These include:

"Developers are the new heroes of the Idea Economy."

  • HP Vertica for SQL on Hadoop native file support, bringing significant increase in performance on popular Hadoop formats like ORC and Parquet. Specifically, HP worked collaboratively with Hortonworks to develop a new high-performance access layer that enables SQL queries to run directly on ORC files, resulting in a 5x increase in execution times.
  • HP Vertica Flex Zone Table Library with which HP has open sourced its innovative Flex Table "schema on-need" technology to the global developer community. With this move, organizations will be able to fully harness virtually any form of semi-structured data to meet their unique needs.
  • HP announced its commitment to integrate Vertica with Apache Spark. This will enable accelerated data transfer between Vertica and Spark, allowing organizations to take full advantage of their Spark-based deployments. This future capability will enable the developer community to build their models in Spark and run them in Vertica for high-speed and sophisticated analytics.

Startup Accelerator

HP also unveiled The HP Haven Startup Accelerator, a new program designed to support and expand HP's ecosystem of developers and innovators by making HP Big Data and Application Delivery Management software products accessible to early-stage companies. The program removes traditional barriers for organizations looking to leverage analytics and data to build powerful, differentiated applications. Qualified participants will benefit from the following program components:

  • Free use of the community versions of HP IDOL and HP Vertica with expanded capacity.
  • Premium version of HP IDOL and HP Vertica with attractive pricing
  • HP Application Delivery Management tools including HP Agile Manager, HP LeanFT, and HP LoadRunner.

HP also announced an innovative framework of technology and proven best practices to accelerate the development of next-generation analytical applications. This framework extends the HP Haven Big Data Platform with quick-start visualization, syndicated data feeds, open on-premise and cloud-based APIs. This enables HP Professional Services and HP partners to quickly deliver a range of solutions, such as voice of customer, smart cities, and fraud detection.

"HP is uniquely positioned to help businesses and developers thrive in this new world."

Optimized platforms for big data include traditional HP ProLiant DL380 clusters, purpose-built Apollo 4510, 4530 and 4200 compute and storage servers, and HP's innovative asymmetric Big Data Reference Architecture. These systems enable customers to optimize their big data workloads, delivering the power of Haven to their business.

Availability Planned availability for new HP Haven Big Data offerings and services is set for fall of 2015.

You may also be interested in:

More Stories By Dana Gardner

At Interarbor Solutions, we create the analysis and in-depth podcasts on enterprise software and cloud trends that help fuel the social media revolution. As a veteran IT analyst, Dana Gardner moderates discussions and interviews get to the meat of the hottest technology topics. We define and forecast the business productivity effects of enterprise infrastructure, SOA and cloud advances. Our social media vehicles become conversational platforms, powerfully distributed via the BriefingsDirect Network of online media partners like ZDNet and IT-Director.com. As founder and principal analyst at Interarbor Solutions, Dana Gardner created BriefingsDirect to give online readers and listeners in-depth and direct access to the brightest thought leaders on IT. Our twice-monthly BriefingsDirect Analyst Insights Edition podcasts examine the latest IT news with a panel of analysts and guests. Our sponsored discussions provide a unique, deep-dive focus on specific industry problems and the latest solutions. This podcast equivalent of an analyst briefing session -- made available as a podcast/transcript/blog to any interested viewer and search engine seeker -- breaks the mold on closed knowledge. These informational podcasts jump-start conversational evangelism, drive traffic to lead generation campaigns, and produce strong SEO returns. Interarbor Solutions provides fresh and creative thinking on IT, SOA, cloud and social media strategies based on the power of thoughtful content, made freely and easily available to proactive seekers of insights and information. As a result, marketers and branding professionals can communicate inexpensively with self-qualifiying readers/listeners in discreet market segments. BriefingsDirect podcasts hosted by Dana Gardner: Full turnkey planning, moderatiing, producing, hosting, and distribution via blogs and IT media partners of essential IT knowledge and understanding.

IoT & Smart Cities Stories
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...
AI and machine learning disruption for Enterprises started happening in the areas such as IT operations management (ITOPs) and Cloud management and SaaS apps. In 2019 CIOs will see disruptive solutions for Cloud & Devops, AI/ML driven IT Ops and Cloud Ops. Customers want AI-driven multi-cloud operations for monitoring, detection, prevention of disruptions. Disruptions cause revenue loss, unhappy users, impacts brand reputation etc.
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...
Atmosera delivers modern cloud services that maximize the advantages of cloud-based infrastructures. Offering private, hybrid, and public cloud solutions, Atmosera works closely with customers to engineer, deploy, and operate cloud architectures with advanced services that deliver strategic business outcomes. Atmosera's expertise simplifies the process of cloud transformation and our 20+ years of experience managing complex IT environments provides our customers with the confidence and trust tha...
The Japan External Trade Organization (JETRO) is a non-profit organization that provides business support services to companies expanding to Japan. With the support of JETRO's dedicated staff, clients can incorporate their business; receive visa, immigration, and HR support; find dedicated office space; identify local government subsidies; get tailored market studies; and more.
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...
As you know, enterprise IT conversation over the past year have often centered upon the open-source Kubernetes container orchestration system. In fact, Kubernetes has emerged as the key technology -- and even primary platform -- of cloud migrations for a wide variety of organizations. Kubernetes is critical to forward-looking enterprises that continue to push their IT infrastructures toward maximum functionality, scalability, and flexibility. As they do so, IT professionals are also embr...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
As you know, enterprise IT conversation over the past year have often centered upon the open-source Kubernetes container orchestration system. In fact, Kubernetes has emerged as the key technology -- and even primary platform -- of cloud migrations for a wide variety of organizations. Kubernetes is critical to forward-looking enterprises that continue to push their IT infrastructures toward maximum functionality, scalability, and flexibility.
Today's workforce is trading their cubicles and corporate desktops in favor of an any-location, any-device work style. And as digital natives make up more and more of the modern workforce, the appetite for user-friendly, cloud-based services grows. The center of work is shifting to the user and to the cloud. But managing a proliferation of SaaS, web, and mobile apps running on any number of clouds and devices is unwieldy and increases security risks. Steve Wilson, Citrix Vice President of Cloud,...