Another MySQL DBA: install

Showing posts with label install. Show all posts

Monday, April 7, 2014

WebScaleSQL Installation solved... part 2

This is a follow up to the : WebScaleSQL Installation attempted... part 1

So being a typical geek, developer, idiot or whatever.. I failed to RTFM or in this case the FAQ.

So once I paid attention and didn't just rush into it, I installed WebScaleSQL correctly.
The biggest problem was that I was using the Linux OS (Oracle Linux VM) which is just too old and the Oracle repositories did little to help get it upgraded. While I wanted to start with something that everyone could use easily, that just was not it.

I downloaded Fedora 20. You can see that they already use GCC 4.8.2.
So the point is simple enough, if you want to use new technology, update your OS as well.

If you really want to upgrade your GCC and stay on your current OS these hyperlinks might be useful:

Below are the steps I took to get it installed. Once the dependencies are in place it is a basic source install.


#cd /usr/local/

#yum -y install gcc git readline-devel  gcc-c++ bison-devel bison cmake ncurses-devel

# gcc -v

gcc version 4.8.2 20131212 (Red Hat 4.8.2-7) (GCC) 



#git clone https://github.com/webscalesql/webscalesql-5.6.git

#ln -s webscalesql-5.6 mysql 

#groupadd mysql

#useradd -r -g mysql mysql

#cd mysql/ 

#cmake . -DENABLE_DOWNLOADS=1

-- Successfully downloaded http://googlemock.googlecode.com/files/gmock-1.6.0.zip

-- Configuring done
-- Generating done
-- Build files have been written to: /usr/local/src/webscalesql-5.6


#make

Scanning dependencies of target INFO_BIN
[  0%] Built target INFO_BIN
Scanning dependencies of target INFO_SRC
[  0%] Built target INFO_SRC
Scanning dependencies of target abi_check
[  0%] Built target abi_check
Scanning dependencies of target zlib
[  1%] Building C object zlib/CMakeFiles/zlib.dir/adler32.c.o
 .....

[100%] Building CXX object mysql-test/lib/My/SafeProcess/CMakeFiles/my_safe_process.dir/safe_process.cc.o
Linking CXX executable my_safe_process
[100%] Built target my_safe_process

#make install

#chmod +x scripts/mysql_install_db
#yum -y install perl-Data-Dumper-Names

#./scripts/mysql_install_db --user=mysql 

#chown -R mysql data

#./bin/mysqld_safe &

# ./bin/mysql



mysql> SELECT VERSION();
+-----------+
| VERSION() |
+-----------+
| 5.6.17    |
+-----------+


mysql> show variables like '%read_only%';
+------------------+-------+
| Variable_name    | Value |
+------------------+-------+
| innodb_read_only | OFF   |
| read_only        | OFF   |
| super_read_only  | OFF   |
| tx_read_only     | OFF   |
+------------------+-------+


cd mysql-test ; perl mysql-test-run.pl

OK now that we got it up and running... we can explore it...

Thursday, March 27, 2014

WebScaleSQL Installation attempted... part 1

Well if you have not see the news yet, then by all means follow this link and read about WebScaleSQL. Many thanks to the team of engineers from Facebook, Twitter and Google for their hard work on this. I am curious to see how this develops more in the future, once I get it to work.

Here is what I encountered so far. I wanted this to be a successful blog post, instead it will be part one until I get it running.

I figured I would put up a little how to install WebScaleSQL for those of you new to Github any of this. It takes feedback from the community after all, so the community needs to be able to install and try it out.

For this example I took the pre-built Oracle Linux Virtual Box image. I had one already but it is available here : http://www.oracle.com/technetwork/server-storage/linux/downloads/vm-for-hol-1896500.html.

It should be obvious that WebScaleSQL is not intended for use on a VirtualBox in production, but this is just a demo. I assumed that it meant that people do not have an excuse to try it out since anyone can download and use this with VirtualBox. I did have to enable the additional disk that come with the image so you have enough space. To format, partition and mount the disks all can be done via disk utility. The finished product for my example is below.

 

[root@oraclelinux6 oracle]# ls -al /media/ 

drwx------  3 oracle oracle 4096 Mar 27 16:19 webscaledisk
drwx------  3 oracle oracle 4096 Mar 27 16:21 workspace

[root@oraclelinux6 oracle]# chmod 777 /media/workspace/
[root@oraclelinux6 oracle]# chmod 777 /media/webscaledisk/

The code for WebScaleSQL is available on Github. The zip file can be downloaded here. I choose to check out the code via the github code repository methods. If others need help with the SSH keys see the Gitbhub reference page.

The git package is not available on Oracle Linux but that is quickly solved if you plan to use the Github version.

 

[oracle@oraclelinux6 ~]$ sudo bash

[root@oraclelinux6 oracle]# yum install curl-devel expat-devel gettext-devel openssl-devel zlib-devel 

[root@oraclelinux6 oracle]# wget http://git-core.googlecode.com/files/git-1.7.10.1.tar.gz 

[root@oraclelinux6 oracle]# tar -xvzf git-1.7.10.1.tar.gz

[root@oraclelinux6 oracle]# cd git-1.7.10.1

[root@oraclelinux6 git-1.7.10.1]# make prefix=/usr/local all

[root@oraclelinux6 git-1.7.10.1]# make prefix=/usr/local install

[root@oraclelinux6 git-1.7.10.1]# exit 

$ git --version
git version 1.7.10.1

Once git and the ssh-keys are ready you can download:



[oracle@oraclelinux6 ~]$ cd /media/workspace/
[oracle@oraclelinux6 workspace]$ git clone https://github.com/webscalesql/webscalesql-5.6.git
Cloning into 'webscalesql-5.6'...
remote: Counting objects: 28637, done.
remote: Compressing objects: 100% (10926/10926), done.
remote: Total 28637 (delta 17074), reused 28419 (delta 16936)
Receiving objects: 100% (28637/28637), 48.01 MiB | 796 KiB/s, done.
Resolving deltas: 100% (17074/17074), done.

OK so however you decided to get the code... Lets us now try to get it installed. To be clear this is should nothing new, this is a basic MySQL source install but it is just using the WebScaleSQL package. It basically follows the same procedure as I did here before.

I needed a few dependancies on this clean system first. You might find you need some as well, it all depends on your system and the result of the cmake command below.

 

[root@oraclelinux6 workspace]# yum -y install ncurses-devel   readline-devel cmake gcc gcc-c++ bison-devel bison 

[root@oraclelinux6 workspace]# wget http://googlemock.googlecode.com/files/gmock-1.6.0.zip

[root@oraclelinux6 workspace]# unzip gmock-1.6.0.zip

[root@oraclelinux6 workspace]# cd gmock-1.6.0 

[root@oraclelinux6 gmock-1.6.0]# ./configure

[root@oraclelinux6 gmock-1.6.0]# make

[root@oraclelinux6 gmock-1.6.0]# make check

.... 

=====================================================
1 of 4 tests failed
Please report to googletestframework@googlegroups.com
=====================================================
make[2]: Leaving directory `/media/workspace/gmock-1.6.0/gtest'
make[1]: Leaving directory `/media/workspace/gmock-1.6.0/gtest'

OK so the next phase (part 2) should be the following once I get the google code to work...

Btw the denable_downloads should download and install the gmock as well but it also fails.

 

[root@oraclelinux6 workspace]# groupadd mysql
[root@oraclelinux6 workspace]# useradd -r -g mysql mysql
[root@oraclelinux6 workspace]# ln -s /media/workspace/webscalesql-5.6/ /usr/local/mysql
[root@oraclelinux6 workspace]# chown -R mysql:mysql webscalesql-5.6/

[root@oraclelinux6 workspace]# cd webscalesql-5.6/ 

[root@oraclelinux6 webscalesql-5.6]# cmake -DENABLE_DOWNLOADS=1 .

make

make install 

./scripts/mysql_install_db --user=mysql

chown -R root .

chown -R mysql data

So not ready just yet.. but I will get back with you all once I get it working. I have faith I will.

Wednesday, March 26, 2014

MySQL and OS X install and remove

So this is in reference to this bug:

http://bugs.mysql.com/bug.php?id=67133

I happen to run across it so I figured what the heck test it out with 5.7 as well.
I was also able to reproduce this error with the latest DMR version. ( at the time of this test mysql-5.7.3-m13 ) I was using the provided DMG and the tar.gz file.

 

dyld: Symbol not found: _strnlen

  Referenced from: /usr/local/mysql/bin/my_print_defaults

  Expected in: /usr/lib/libSystem.B.dylib

The DMG has a nice little installer and etc but as you can see it did not work.

So to test the 5.5 version you have to remove MySQL from OS X

 

rm -rf /usr/local/mysql* 

rm -rf /Library/StartupItems/MySQLCOM

rm -Rf /private/var/db/receipts/*mysql*

I just needed those but this site has a list of other references if you need it.

I was able to confirm that 5.5.36 does install and run. So you are just out of luck for the moment if you want a higher version of MySQL .

One note.. Read the information screen or the readme.txt file. It gives helpful information.

 

 mysql> select @@hostname;

+----------------------+

| @@hostname           |

+----------------------+

| MacBook-Pro-15.local |

+----------------------+

1 row in set (0.01 sec)



mysql> select VERSION();

+-----------+

| VERSION() |

+-----------+

| 5.5.36    |

+-----------+

1 row in set (0.00 sec)

Wednesday, June 12, 2013

MariaDB 10.0.3 Alpha install on Fedora 17 x86_64

MariaDB 10.0.3 Alpha was just released.
So for those of you that recall my previous MariaDB 5.5 install post, I decided to see how it works with 10.0.3.

I like some of the features that are going into the MariaDB and Percona releases. Even if you are a big supporter of MySQL, when features are available in these releases that are not being back ported into MySQL releases DBAs have to review their options and make a choice.

So the install....

As I said before from the previous post I have this installed. So I will just to an upgrade first.

 

[root@Fedora64 10]# rpm -qa | grep maria

mariadb-5.5.31-1.fc17.x86_64

mariadb-server-5.5.31-1.fc17.x86_64

mariadb-libs-5.5.31-1.fc17.x86_64

mariadb-bench-5.5.31-1.fc17.x86_64

mariadb-devel-5.5.31-1.fc17.x86_64

So packages conflicted at the start.

 

MariaDB-10.0.3-fedora17-x86_64-client.rpm

MariaDB-10.0.3-fedora17-x86_64-common.rpm

MariaDB-10.0.3-fedora17-x86_64-compat.rpm

MariaDB-10.0.3-fedora17-x86_64-connect-engine.rpm

MariaDB-10.0.3-fedora17-x86_64-devel.rpm

MariaDB-10.0.3-fedora17-x86_64-server.rpm

MariaDB-10.0.3-fedora17-x86_64-shared.rpm

MariaDB-10.0.3-fedora17-x86_64-test.rpm

[root@Fedora64 10]# rpm -Uhv *.rpm

warning: MariaDB-10.0.3-fedora17-x86_64-client.rpm: Header V3 DSA/SHA1 Signature, key ID 1bb943db: NOKEY

error: Failed dependencies:

    libodbc.so.2()(64bit) is needed by MariaDB-connect-engine-10.0.3-1.x86_64

    MySQL-devel conflicts with (installed) mariadb-devel-5.5.31-1.fc17.x86_64

MariaDB-server-10.0.3-1.x86_64 conflicts with file from package mariadb-server-5.5.31-1.fc17.x86_64

[root@Fedora64 10]#

So this is just a Virtualbox instance, for demo and evaluation, so I just removed all that I could and had to uninstall. I was hopeful that an upgrade would work but this is Alpha code still.
ie:

 

[root@Fedora64 10]# rpm -e mariadb mariadb-server mariadb-bench 

[root@Fedora64 10]# rpm -e mariadb-libs perl-DBD-MySQL percona-xtrabackup

So now that the past is cleared out...

 

[root@Fedora64 10]# rpm -ihv *.rpm 

Preparing...                ########################################### [100%]

   1:MariaDB-common         ########################################### [ 11%]

   2:MariaDB-server         ########################################### [ 22%]

   3:MariaDB-cassandra-engin########################################### [ 33%]

   4:MariaDB-client         ########################################### [ 44%]

   5:MariaDB-devel          ########################################### [ 56%]

   6:MariaDB-shared         ########################################### [ 67%]

   7:MariaDB-test           ########################################### [ 78%]

   8:MariaDB-compat         ########################################### [ 89%]

   9:galera                 ########################################### [100%]

If you recall the past post, I got the init.d script this time..

 

[root@Fedora64 10]# /etc/init.d/mysql start

Starting MySQL..... SUCCESS!

[root@Fedora64 10]# mysql

Welcome to the MariaDB monitor.  Commands end with ; or \g.

Your MariaDB connection id is 2

Server version: 10.0.3-MariaDB MariaDB Server

If they are not terrible on performance then I do not see why these are not on by default:

 

vi /etc/my.cnf

[mysqld]

userstat=1
# http://www.percona.com/doc/percona-server/5.5/diagnostics/user_stats.html?id=percona-server:features:userstatv2
# https://kb.askmonty.org/en/user-statistics/

feedback=ON 

# https://kb.askmonty.org/en/user-feedback-plugin/

MariaDB [(none)]> show variables like '%feedback%';
+--------------------------+------------------------------------------+
| Variable_name            | Value                                    |
+--------------------------+------------------------------------------+
| feedback_send_retry_wait | 60                                       |
| feedback_send_timeout    | 60                                       |

...
| feedback_url             | https://mariadb.org/feedback_plugin/post |
| feedback_user_info       |                                          |
+--------------------------+------------------------------------------+

MariaDB [(none)]> show variables like '%userstat%';
+---------------+-------+
| Variable_name | Value |
+---------------+-------+
| userstat      | ON    |
+---------------+-------+

Issues I found 30seconds after install...:

 

MariaDB [(none)]> show variables;

ERROR 1946 (HY000): Failed to load replication slave GTID position from table mysql.gtid_slave_pos

That is it so far... I have it installed and can review now...

UPDATE:
I have submitted this as a bug. The MariaDB team got right back to me and pointed out that I failed to run mysql_upgrade and restart. That fixed the Error listed above. Still variables feels like it should show everything it has but this is a valid fix and mistake on my part. Thank you to the MariaDB team.

To learn more:

Pages