Recently I was working to setup a Big Data environment in Azure.
From Azure Data Factory I was spinning up an on-demand HDInsight Cluster with an external metastore.
Unfortunately I was always getting the following error: “Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient”.
After contacting Microsoft for support about this error they found the error was caused by a known Hadoop bug:
In short the error was caused by having dashes (-) in the name of the metastore database. After removing the dashes the problem disappeared and I was able to create the on-demand HDInsight cluster.
An excerpt of the error log, the name of my metastore was db-metastore-p:
Logging initialized using configuration in file:/C:/apps/dist/hive-0.14.0.2.2.9.1-1/conf/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/C:/apps/dist/hadoop-184.108.40.206.2.9.1-1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/C:/apps/dist/hbase-0.98.4.2.2.9.1-1-hadoop2/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
... 8 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
... 13 more
Caused by: javax.jdo.JDOUserException: Could not create "increment"/"table" value-generation container db-metastore-p.dbo.SEQUENCE_TABLE since autoCreate flags do not allow it.
org.datanucleus.exceptions.NucleusUserException: Could not create "increment"/"table" value-generation container db-metastore-p.dbo.SEQUENCE_TABLE since autoCreate flags do not allow it.
For DSM 5 the paths are changed:
- DSM 4: /usr/syno/etc/httpd-ssl-vhost.conf-user
- DSM 5: /etc/httpd/sites-enabled-user/httpd-ssl-vhost.conf-user
I want to be able to access my Synology Disk Station Management (DSM) from the internet in a secure way through https.
DSM is standard running on the Synology in https mode on port 5001, so we need to setup a reverse proxy in apache:
Access the Synology with SSH using Putty, en type the following commands in the shell prompt to navigate to the right folder:
For DSM 4:
For DSM 5:
Continue reading “Access Synology DSM from the internet with a Reverse Proxy”
Few days ago i was reading a nice post from Scott Hanselman’s blog about Windows 8 enhanced keyboard shortcuts.
Here is a summary of the keys:
- Win+E – Explorer
- Win+R – Run
- Win+Break – System Info
- Win+D – Desktop (I use this constantly if I get trapped outside the Desktop world)
- Win+Plus or Win+Minus (no shift) – Magnifier/Zoom In and Out
- Alt-Tab – Switch between Apps
- Win-Tab – Switch between Full Screen Apps
- Win+W – Search Control Panel and Settings stuff
- Win+F – Search Files
- Esc – Yes, escape. No joke. If you hit the Windows Key, you can hit Escape to go back.
- Win+C – Charms (right side menu) then arrows to move and enter to launch.
- Win+K – Devices
- Win+I – Settings in any app plus brightness, network and other useful system features
- Win+Arrows – Snap desktop apps to the sides
- Win+(period) – Alternate sides to “snap” Metro Apps. Add shift to reverse it.
- Win-X – Admin Stuff. It’s REALLY useful.
- Win+PageUp or Win+PageDn – Move full screen apps to other monitors. Super useful for News apps and Readers. The Start Screen can be moved as well.
Today i was trying to install Windows 8 Pro on my Dell Latitude E6510 laptop with UEFI enabled.
You can enable UEFI from the bios, (i first installed the most recent bios version) under boot section and then select UEFI.
But with my disappointment i couldn’t boot from my USB key with the windows bootable installation on it.
I prepared the USB key with the Windows 7 USB/DVD Download Tool, a nice tool from Microsoft to make installation from USB possible from an ISO Windows installation image.
After a little bit research on the net i found here that the installation on UEFI is possible only in some circumstances and that the USB Download Tool was useless. Continue reading “Install Windows with UEFI on Dell Latitude”
This is a step-by-step guide to install OpenElec 1.0.2 on an Asrock ION 3D 152d, and optionally configuring a Logitech Harmony Remote.
Go to the OpenElec site and download the ION build (i have downloaded the i386 build, but the x86_64 i think will work too with this guide).
- Make a bootable USB key from your PC using this guide if you are on Windows PC, or this guide for Linux PC.
- Install OpenElec on your Asrock using this guide.
Continue reading “Install OpenElec 1.0.2 on Asrock ION 3D 152d and a Logitech Harmony Remote”
Since DSM 5 the paths are changed:
I’m an owner of a Synology DS211 and i have installed Sabnzbd+ on it, using this helpful package http://synoblog.superzebulon.org/2011/09/sabnzbd-0-6-9-1-spk/ (add it to your favorites, it’s a really nice site with more packages to download).
My Synology is running on the latest 3.2 firmware.
After installation Sabnzbd+ is running on the following address http://private-diskstation-ip:8080, and i wanted to make it accessible in a secure way from the internet.
I want to be able to access the sabnzbd+ instance only from https and with a user/password prompt.
Continue reading “Run sabnzbd+ behind Apache on Synology”
Few weeks ago i was fixing a bug in Sharepoint 2010 project available on the internet. The requirement was to prevent access from authenticated users who knows the special Sharepoint addresses (such as _layouts, etc..). Continue reading “Blocking access to application pages (_layouts) and Forms Pages”