Archive for July, 2010
Top 10 Best Cheat Sheets and Tutorials for Linux / UNIX Commands
Cheat sheet act as a reference tool which provides cut and paste kind of commands to complete a specific task. I often recommend following set of best cheat sheets to students and IT professionals. It include Linux / UNIX command and shell scripting.
Unix Toolbox
This document is a collection of Unix/Linux/BSD commands and tasks which are useful for IT work or for advanced users. This is a practical guide with concise explanations, however the reader is supposed to know what s/he is doing.
=> Visit UNIX Toolbox
UNIX Tutorial for Beginners
A beginners guide to the Unix and Linux operating system. Eight simple tutorials which cover the basics of UNIX / Linux commands.
=> Visit UNIX Tutorial for Beginners
Linux Command and Learning Shell Tutorials
You have Linux installed and running. The GUI is working fine, but you are getting tired of changing your desktop themes. You keep seeing this “terminal” thing. Don’t worry, this site will show you what to do.
=> Visit Learning the shell
Learn UNIX in 10 minutes
This is something that I had given out to students (CAD user training) in years past. The purpose was to have on one page the basics commands for getting started using the UNIX shell (so that they didn’t call me asking what to do the first time someone gave them a tape).
=> Visit Learning UNIX in 10 minutes
How To Look Like A UNIX Guru
This lecture takes you through the basic commands and then shows you how to combine them in simple patterns or idioms to provide sophisticated functionality like histogramming. This lecture assumes you know what a shell is and that you have some basic familiarity with UNIX.
=> Visit How To Look Like A UNIX Guru
Linux command line reference
Another very good Linux command line reference for common operations.
=> Visit Linux Command Line Reference
Linux-Unix cheat sheets – The ultimate collection
Links to good reference material on various topics.
=> Visit Linux-Unix cheat sheets – The ultimate collection
Alphabetical Directory of Linux Commands
This directory of Linux commands is from Linux in a Nutshell, 5th Edition. You can view total 687 commands to get a description and list of available options.
=> Visit directory of Linux commands
A Sysadmin’s Unixersal Translator (ROSETTA STONE)
A simple and nice lookup table for Linux / UNIX / BSD commands.
=> Visit Sysadmin’s Unixersal Translator (ROSETTA STONE) (PDF version)
BigAdmin – System Administrator Resources and Community
Sun has BigAdmin portal with tons of information regarding UNIX, shell scripting and much more.
=> Visit BigAdmin System Administration Portal- Shell Commands (see their home page for more resources)
Ref:cyberciti.biz
HowTo: Migrate / Move MySQL Database And Users To New Server
I already wrote about how to move or migrate user accounts from old Linux / UNIX server to a new server including mails and home directories. However, in reality you also need to move MySQL database which may host your blog, forum or just your data stored in MySQL database. The mysqldump command will only export the data and the table structure but it will not include a users grants and privileges. The main function of the MySQL privilege system (which is stored in mysql.user table) is to authenticate a user who connects from a given host and to associate that user with privileges on a database such as SELECT, INSERT, UPDATE, and DELETE.
Our Sample Setup
+-----+
| db1 | -------------------------> -+
+-----+ |
old mysql server |
(192.168.1.8) |
+-----+ | ///////////////////////////////
| db2 | -------------------------> -+------> // Internet (ISP router //
+-----+ | // with port 80 forwarding) //
new mysql server | ///////////////////////////////
(192.168.1.10) |
+-----+ |
| www1| -------------------------> -+
+-----+
Apache web server
(192.168.1.5)
You need to move db1 server database called blogdb and its users to db2 server.
Install MySQL On DB2
Use the apt-get or yum command to install mysql on DB2 server:
$ sudo apt-get install mysql-server mysql-client
$ sudo service mysql start
# set root password for new installation
$ mysqladmin -u root password NEWPASSWORD
OR
$ sudo yum install mysql-server mysql
$ sudo chkconfig mysql on
$ sudo service mysql start
# set root password for new installation
$ mysqladmin -u root password NEWPASSWORD
Make sure OpenSSH server is also installed on DB2.
Get Current MySQL, Usernames, Hostname, And Database Names
Type the following command at shell prompt to list username and hostname list, enter:
mysql -u root -B -N -p -e "SELECT user, host FROM user" mysql
Sample outputs:
vivek 192.168.1.5 tom 192.168.1.5 blog 192.168.1.7 root localhost db1.vm.nixcraft.net.in root db1.vm.nixcraft.net.in
The first column is mysql username and second one is network host names. Now, type the following command to get exact details about grants and password for each user from above list:
mysql -u root -p -B -N -e"SHOW GRANTS FOR 'userName'@hostName" mysql -u root -p -B -N -e"SHOW GRANTS FOR 'vivek'@192.168.1.5"
Sample outputs:
GRANT USAGE ON *.* TO 'vivek'@'192.168.1.5' IDENTIFIED BY PASSWORD 'somePasswordMd5' GRANT ALL PRIVILEGES ON `blogdb`.* TO 'vivek'@'192.168.1.5'
Where,
- vivek – MySQL login username
- 192.168.1.5 – Another server or workstation to access this mysql server
- somePasswordMd5 – Password stored in mysql database which is not in a clear text format
- blogdb – Your database name
Now, you’ve all info and you can move database and users to a new server called db2 as follows using the combination of OpenSSH ssh client and mysql clients as follows:
ssh user@db2 mysql -u root -p'password' -e "create database IF NOT EXISTS blogdb;" ssh user@db2 mysql -u root -p'password' -e "GRANT USAGE ON *.* TO 'vivek'@'192.168.1.5' IDENTIFIED BY PASSWORD 'somePasswordMd5';" ssh user@db2 mysql -u root -p'password' -e "GRANT ALL PRIVILEGES ON `blogdb`.* TO 'vivek'@'192.168.1.5';" mysqldump -u root -p'password' -h 'localhost' blogdb | ssh user@db2 mysql -u root -p'password' blogdb
You can test it as follows from Apache web server:
$ mysql -u vivek -h 192.168.1.10 -p blogdb -e 'show tables;'
A Note About Web Applications
Finally, you need to make changes to your application to point out to new a database server called DB2. For example, change the following from:
$DB_SERVER = "db1.vm.nixcraft.net.in";
$DB_USER = "vivek";
$DB_PASS = "your-password";
$DB_NAME = "blogdb";
To:
$DB_SERVER = "db2.vm.nixcraft.net.in";
$DB_USER = "vivek";
$DB_PASS = "your-password";
$DB_NAME = "blogdb";
A Sample Shell Script To Migrate Database
#!/bin/bash
# Copyright (c) 2005 nixCraft project <http://cyberciti.biz/fb/>
# This script is licensed under GNU GPL version 2.0 or above
# Author Vivek Gite <vivek@nixcraft.com>
# ------------------------------------------------------------
# SETME First - local mysql user/pass
_lusr="root"
_lpass="MySQLPassword"
_lhost="localhost"
# SETME First - remote mysql user/pass
_rusr="root"
_rpass="mySQLPassword"
_rhost="localhost"
# SETME First - remote mysql ssh info
# Make sure ssh keys are set
_rsshusr="vivek"
_rsshhost="db2.vm.nixcraft.net.in"
# sql file to hold grants and db info locally
_tmp="/tmp/output.mysql.$$.sql"
#### No editing below #####
# Input data
_db="$1"
_user="$2"
# Die if no input given
[ $# -eq 0 ] && { echo "Usage: $0 MySQLDatabaseName MySQLUserName"; exit 1; }
# Make sure you can connect to local db server
mysqladmin -u "$_lusr" -p"$_lpass" -h "$_lhost" ping &>/dev/null || { echo "Error: Mysql server is not online or set correct values for _lusr, _lpass, and _lhost"; exit 2; }
# Make sure database exists
mysql -u "$_lusr" -p"$_lpass" -h "$_lhost" -N -B -e'show databases;' | grep -q "^${_db}$" || { echo "Error: Database $_db not found."; exit 3; }
##### Step 1: Okay build .sql file with db and users, password info ####
echo "*** Getting info about $_db..."
echo "create database IF NOT EXISTS $_db; " > "$_tmp"
# Build mysql query to grab all privs and user@host combo for given db_username
mysql -u "$_lusr" -p"$_lpass" -h "$_lhost" -B -N \
-e "SELECT DISTINCT CONCAT('SHOW GRANTS FOR ''',user,'''@''',host,''';') AS query FROM user" \
mysql \
| mysql -u "$_lusr" -p"$_lpass" -h "$_lhost" \
| grep "$_user" \
| sed 's/Grants for .*/#### &/' >> "$_tmp"
##### Step 2: send .sql file to remote server ####
echo "*** Creating $_db on ${rsshhost}..."
scp "$_tmp" ${_rsshusr}@${_rsshhost}:/tmp/
#### Step 3: Create db and load users into remote db server ####
ssh ${_rsshusr}@${_rsshhost} mysql -u "$_rusr" -p"$_rpass" -h "$_rhost" < "$_tmp"
#### Step 4: Send mysql database and all data ####
echo "*** Exporting $_db from $HOSTNAME to ${_rsshhost}..."
mysqldump -u "$_lusr" -p"$_lpass" -h "$_lhost" "$_db" | ssh ${_rsshusr}@${_rsshhost} mysql -u -u "$_rusr" -p"$_rpass" -h "$_rhost" "$_db"
rm -f "$_tmp"
How Do I Use This Script?
Download the above script and edit it to set the following as per your setup:
# SETME First - local mysql DB1 admin user/password _lusr="root" _lpass="MySQLPassword" _lhost="localhost" # SETME First - remote mysql DB2 admin user/password _rusr="root" _rpass="mySQLPassword" _rhost="localhost" # Remote SSH Server (DB2 SSH Server) # Make sure ssh keys are set _rsshusr="vivek" _rsshhost="db2.vm.nixcraft.net.in"
In this example, migrate a database called wiki with wikiuser username:
$ ./script.sh wiki wikiuser
Server moved – 14/July/2010
Dear User,
In the last two days nixcraft moved to the new server (details about our older setup are here). No data is lost and most of the stuff is back as usual. The new server is much more stable. However, required libraries for RSS feed and PDF file generation code are not installed. I will fixed it ASAP. If any one see any other errors or 404 errors, please send me an email at vivek@nixcraft.com. Please ignore rss feed which is currently showing all old entires in your feed. My apologies for the temporary inconvenience and flooding your rss feed and inbox. The IPv6 AAAA entries will be published later on this weekend.
Thanks for all your support!
Ref:cyberciti.biz
–Vivek Gite
Chomaskandar's Blog 