Rolling shells

One of my favorite tools for hard driver cloning, and as i use it for rapid server deployment. Clonezilla is very fast, faster than commercial tools for disk cloning, and has no problems with cloning grub and such.

here is the entire announcement  by Steven Shiau: 

We are happy to announce this new stable release. In this release, we 
have 2 more new languages, and some improvement about cloning MS 
windows. The details:
- Based on Debian Lenny repository on Jan/26/2009. Newer kernel 
2.6.26-13 is used.
- Italian language files were added. Thanks to Gianfranco Gentili.
- Spanish language files were added. Thanks to Juan Ramón Martínez 
<jrmc77 _at_ terra es>.
- Language files fr_FR was updated. Thanks to Jean-Francois Nifenecker.
- Language files zh_CN.UTF-8 was updated. Thanks to Zhiqiang Zhang.
- Language files it_IT was updated. Thanks to Gianfranco Gentili.
- Language files ja_JP.UTF-8 was updated. Thanks to Annie Wei.
- Collecting hardware info now is faster.
- Functions to save and resore hidden data between MBR and 1st partition 
were added for ocs-sr and ocs-onthefly 
(https://sourceforge.net/forum/message.php?msg_id=5471665). Thanks to 
Alberto (arbouzas), david adamo and jess (jessdk).
- Option -j2 and -j3 for saving or restoring hidden data were added in 
drbl-ocs and ocs-sr.
- Option -j2 for cloning hidden data was added in ocs-onthefly.
- The option to use ntfsreloc (-e1 auto) to fix CHS based on the value 
of EDD was added. Thanks to Orgad Shaneh, Antorz and Louie Chen.
- Function get_RawCHS_of_HD_from_sfdisk was added and will be used as a 
backup plan for partclone.ntfsreloc 
(https://sourceforge.net/forum/message.php?msg_id=6181406). Thanks to 
Orgad Shaneh.
- Option -V of ntfsclone restoring is on in ocs-onthefly.
- ntfs-3g mounting warning in prep-ocsroot is off now.
- Before restoring or saving, user must enter y/yes/n/no. It can not be 
nothing.
- An option -z2p for parallel bzip2 was added.
- An option -e1|–change-geometry was added to ocs-sr and drbl-ocs.
- If batch mode is on, we won’t find the serial no of harddrive.
- Program create-ocs-tmp-img was improved with some options and more prompt.
- An example “clone-multiple-usb-example.sh” to clone an image to 
several USB flash drives was added. Thanks to Alvin Su.
- When choosing restoring partitions only, we should not restore swap 
partition. Thanks to Samwise Foxburr for this bug report.
- Bug fixed: ocs-get-part-info input parameters was wrongly parsed.
- Bug fixed: LVM might use ID=83 in partition table, therefore we should 
not parse it based on partition ID 

(https://sourceforge.net/tracker2/?func=detail&atid=671650&aid=2528606&group_id=115473).
- Bugs fixed: ocs-iso and ocs-live-dev were fixed (ID: 2465945). Thanks 
to Orgad Shaneh.
- Bugs fixed: ocs-live-dev was broken for -m 
(https://sourceforge.net/forum/message.php?msg_id=6099180). Thanks to 
lucsmitty (gregs).
- Bug fixed: Some parameters after inputed again did not work when 
running “ocs-sr -x”.
- Bug fixed: When choosing partition, extended or swap should not be 
listed (due to the command of “file -Ls” won’t show any “extended” info 
about a partition in Debian Lenny. We switch to use ocs-get-part-info 
instead of file).

Enjoy!

Download: clonezilla-live-1.2.1-39.iso (95.2MB, MD5).

First we will install build-essential, foomatic-filters, cupsys with the following commands:
       

$ su
# apt-get install build-essential
# apt-get install foomatic-filters
# apt-get install cupsys
   

Then we have to get the necessary firmware and software. 
$ wget -O foo2zjs.tar.gz http://foo2zjs.rkkda.com/foo2zjs.tar.gz
$ tar zxf foo2zjs.tar.gz
$ cd foo2zjs
$ make
$ ./getweb 1018
$ su
# make install install-hotplug cups

Than we open it with Firefox web browser

$ firefox http://localhost:631

Ако пуснем Линукса и принтера е пуснат чрез USB,  можем да го накараме да си свали автоматично firmware като извършим една стъпка:

Now if we start linux with the usb printer plugged in, we can make it automatically download and apply it new firmware. This is done via:

# make install-hotplug

Reset the printer.

The printer will load every time with the init during the printer device scan.

Credits for this one to masteryt from linux-bg

Not a big news, but its useful. I found it interesting since i mainly use CentOS for my server:

Here is it, directly from Karanbir’s blog:

Its amazing how often this question gets asked. Often enough that I thought its worth blogging about. Anyway the short answer is – you dont really need any services running on the machine in order to boot it, login and be able to do things. You might need to start services on demand though, eg if you need a mysql server running, thats a service that needs running. However, its a good idea, imho, to have atleast these services enabled and running :

syslog
network
sshd


syslog: because its good to have logging on the machine, and network + sshd just to make sure you can get to the machine from a remote location, and you can run yum updates ( either local or remote ) with the network working.

If you are running with selinux, it might also be a good idea to have restorecond running, but look into some details, its not really *required* as such.

Looks like finally they are done with the encrypted disk. I was reading trough redhat’s blogs about rhel 5.3 release and it feels so good at the very bottom of the post.

Updates on virtualization also sounds very cool, but linux still lacks good tools for provisioning and management. Any way i am planing to do run some tests when CentOS 5.3 comes out.

Here is it, straight from redhat :

We released the first glimpse into Red Hat Enterprise Linux5.3 with the availability of the5.3 Beta in October. Today, we’ve announced the general availability of Red Hat Enterprise Linux 5.3, delivered via Red Hat Network to customers with a Red Hat subscription.

A key benefit of a Red Hat subscription is that feature updates and fixes are incorporated into the base platform release in such a way that interfaces (APIs & ABIs) are held stable. You can adopt the latest open source capabilities without needing to recertify your hardware and applications. Today’s delivery of Red Hat Enterprise Linux 5.3, with its wide range of new features, demonstrates our commitment to deliver value via your subscription.

Red Hat Enterprise Linux updates provide:

• Feature enhancements and stable new features
• Security hardening
• Consolidated bug fixes

The Red Hat Enterprise Linux 5.3 Release Notes note over 150 updates and upgrades, but here are a few key highlights:

Virtualization enhancements: Red Hat Enterprise Linux 5.3 supports larger x86-64 systems. The number of supported physical CPUs is increased to 126, while maximum memory is increased to 1TB. Virtual server CPU and memory limits have been increased to 32 and 80GB respectively – far higher than competing virtualization products. Additionally the per-guest limits for disks and network interfaces have also been increased. The performance and range of paravirtualized device drivers has been increased, enabling ever more applications to be deployed on virtual servers with near bare-metal performance.

Next-generation hardware enablement: The soon-to-be-released Tylersberg/Nehalem platform is the next-generation of Intel x86-64 hardware. Support for the virtualization and performance features provided by this processor combined with numerous optimizations have already demonstrated exceptional performance over previous processor generations in internal Red Hat testing.

OpenJDK: Red Hat is taking a leadership position in Red Hat Enterprise Linux 5.3 by shipping the first productized implementation of OpenJDK. OpenJDK in 5.3 has passed the full Java SE 6 TCK and is compatible with all applications written for Java SE 6 and previous versions. With the integration of OpenJDK, Red Hat Enterprise Linux 5.3 is the the first enterprise-ready solution with a fully open source Java stack when combined with JBoss Enterprise Application Platform.

Systemtap: This is an application development tool targeted at dynamically allowing applications to be monitored and diagnosed. With Red Hat Enterprise Linux 5.3 support for User Mode (i.e. application level) tracing and profiling is provided for the first time – adding to the Kernel Mode support that was provided in earlier releases. The operative word here being “dynamically,” as the key benefit of Systemtap is the ability, on-the-fly, to add instrumentation, probe points, and memory tracking to running applications. This is key to enable identification and resolution of issues in live environments. Extremely powerful — both for user and kernel space.

Power management: With “green IT” gaining increasing focus, we have been implementing a progression of power-saving enhancements in every update of Red Hat Enterprise Linux. 5.3 is no exception, with improved handling of low-level power management low-power sleep states.

Disk encryption: Critical for laptop use, but also becoming increasingly important in server deployments (due to concerns with hardware disposal at the end of its lifecycle), Red Hat Enterprise Linux 5.3 includes full support for encryption of storage, either at the block level or file system level. Installer enhancements enable encryption to be configured at installation time, and includes support for the root and swap devices.

Well, as most of you may already know, Red Hat has released RHEL version 5 update 3 today, and they appear to have been quite hard at work. So what can you all expect in CentOS 5.3? Here’s a brief rundown of cool stuff to look forward to:

Networking

• NetWorkManager and wpa_supplicant updates mean better wireless security support. NetworkManager has a whole host of updates listed, so loads of good things have been happening there.
• Updated driver support for a number of broadcom, forcedeth, ralink, and realtek cards made it into the kernel, so those of you in irc complaining that your nic wasn’t recognized should be happier after this.
• There are also a few improvements for intel networking, both wired and wireless, so that should give the intel crowd their feel-good too.

Storage

This is where things get interesting, so hang on.

• ext4 support is now included, so you can feel free to play with it. All accounts have it being pretty interesting.
• encrypted block devices are now supported in anaconda for direct install. Anyone with a laptop should be interested in this one. (This one is my personal favorite. A die-hard suse fan always rubs on this when we debate)
• There’s added support for IBM’s DS4xxx series disk systems in the dm_multipath package now. In theory this should rid us of the rdac driver update reboot hell. I’ll be testing this feature out tomorrow.
• 3ware and megaraid_sas also made the cut for driver updates. These two should have a fair bit of performance improvements to them.

One thing I’m still waiting to see sorted out is the httpd fiasco on x86_64. In previous releases, you could install both, but it would cause conflicts when run. RH says they fixed this by removing the x86_64 version of httpd from the x86_64 distro. I’m really hoping they mean that they’ve removed the x86 version from the x86_64 distro, and that the release notes just have a nice little heart-stopping typo. Anyone dealing with multi-arch issues might want to keep an eye on this one between visits to the therapist.

Update: Seems the httpd issue was for ppc, though the arch was not clearly spelled out in the release notes. Have a look at http://www.redhat.com/archives/rhelv5-list/2009-January/msg00098.html for information.

You can get the full reading on what’s coming from this url: http://www.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/5/html/Release_Notes/index.html

What features are you looking forward to the most with the new release? I’m curious to see which features people are most interested in using. Let me know in the comments below.

I am usually installing only “Base” package when i am setting servers, but some of the servers require development packages to complete the final task. Kernel rebuilding for example, or some third party you want to get running.

These tools include core development tools such as automake, gcc, perl, python, and debuggers:
=> flex
=> gcc
=> redhat-rpm-config
=> strace
=> rpm-build
=> make
=> pkgconfig
=> gettext
=> automake
=> strace64
=> gdb
=> bison
=> libtool
=> autoconf
=> gcc-c++
=> binutils and all dependencies.

The easy way to do that is opening terminal or ssh shell and  type in:

# yum groupinstall 'Development Tools'

Sample output:

Loading "fastestmirror" plugin
Loading mirror speeds from cached hostfile
 * base: mirror.steadfast.net
 * updates: dist1.800hosting.com
 * addons: centos.mirrors.tds.net
 * extras: dist1.800hosting.com
Setting up Group Process
Loading mirror speeds from cached hostfile
 * base: mirror.steadfast.net
 * updates: dist1.800hosting.com
 * addons: centos.mirrors.tds.net
 * extras: dist1.800hosting.com
Package make - 1:3.81-3.el5.i386 already installed and latest version
Package gettext - 0.14.6-4.el5.i386 already installed and latest version
Package binutils - 2.17.50.0.6-6.el5.i386 already installed and latest version
Resolving Dependencies
--> Running transaction check
---> Package automake.noarch 0:1.9.6-2.1 set to be updated
---> Package frysk.i686 0:0.0.1.2008.03.19.rh1-1.el5 set to be updated
--> Processing Dependency: libgcj.so.7rh for package: frysk
--> Processing Dependency: glib-java >= 0.2.6 for package: frysk
---> Package autoconf.noarch 0:2.59-12 set to be updated
--> Processing Dependency: imake for package: autoconf
---> Package rcs.i386 0:5.7-30.1 set to be updated
---> Package strace.i386 0:4.5.16-1.el5.1 set to be updated
---> Package redhat-rpm-config.noarch 0:8.0.45-24.el5 set to be updated
---> Package elfutils.i386 0:0.125-3.el5 set to be updated
--> Processing Dependency: libdw.so.1 for package: elfutils
...........
....
..
Transaction Summary
=============================================================================
Install    105 Package(s)
Update       0 Package(s)
Remove       0 Package(s)         

Total download size: 127 M
Is this ok [y/N]: y
Downloading Packages:
(1/105): python-numeric-2 100% |=========================| 751 kB    00:12
(2/105): xorg-x11-fonts-b 100% |=========================| 3.7 MB    01:03
(3/105): pfmon-3.2-0.0609 100% |=========================| 656 kB    00:10
(4/105): automake14-1.4p6 100% |=========================| 205 kB    00:03
(5/105): libtool-1.5.22-6 100% |=========================| 680 kB    00:11
(6/105): systemtap-0.6.2- 100% |=========================| 1.3 MB    00:22

Now you can compile and use any application on system.

Well, as most of you may already know, Red Hat has released RHEL version 5 update 3 today, and they appear to have been quite hard at work. So what can you all expect in CentOS 5.3? Here’s a brief rundown of cool stuff to look forward to:

Networking

• NetWorkManager and wpa_supplicant updates mean better wireless security support. NetworkManager has a whole host of updates listed, so loads of good things have been happening there.
• Updated driver support for a number of broadcom, forcedeth, ralink, and realtek cards made it into the kernel, so those of you in irc complaining that your nic wasn’t recognized should be happier after this.
• There are also a few improvements for intel networking, both wired and wireless, so that should give the intel crowd their feel-good too.

Storage

This is where things get interesting, so hang on.

• ext4 support is now included, so you can feel free to play with it. All accounts have it being pretty interesting.
• encrypted block devices are now supported in anaconda for direct install. Anyone with a laptop should be interested in this one. (This one is my personal favorite. A die-hard suse fan always rubs on this when we debate)
• There’s added support for IBM’s DS4xxx series disk systems in the dm_multipath package now. In theory this should rid us of the rdac driver update reboot hell. I’ll be testing this feature out tomorrow.
• 3ware and megaraid_sas also made the cut for driver updates. These two should have a fair bit of performance improvements to them.

One thing I’m still waiting to see sorted out is the httpd fiasco on x86_64. In previous releases, you could install both, but it would cause conflicts when run. RH says they fixed this by removing the x86_64 version of httpd from the x86_64 distro. I’m really hoping they mean that they’ve removed the x86 version from the x86_64 distro, and that the release notes just have a nice little heart-stopping typo. Anyone dealing with multi-arch issues might want to keep an eye on this one between visits to the therapist.

Update: Seems the httpd issue was for ppc, though the arch was not clearly spelled out in the release notes. Have a look athttp://www.redhat.com/archives/rhelv5-list/2009-January/msg00098.html for information.

You can get the full reading on what’s coming from this url:  http://www.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/5/html/Release_Notes/index.html

What features are you looking forward to the most with the new release? I’m curious to see which features people are most interested in using. Let me know in the comments below.

You may have heard it by now, RHEL 5.3 has been released.
Red Hat Enterprise Linux 5.3 confirms Red Hat’s commitment to Xen with a lot of virtualization enhancements, desktop enhancements, new hardware support, kernel improvements, includes openjdk and much more from the release notes.

This also triggers the CentOS 5.3 rebuild process which consists of the rebuilding of the SRPMs, removing use of trademark and artwork, patching CentOS specifics (eg. anaconda installer), fixing RPM spec files to (eg. self-hosting environment) and validations by the QA team. This process usually takes between 3 to 5 weeks.

You can follow the CentOS 5.3 rebuild process now via twitter.

For those like me who would like to check ESXi 3.5 update 3 but don’t want to install on a local harddisk. Here’s a good pdf about how to install it on a USB memory key. It’s fairly easy and I just booted my Intel s3000ah with ESXi.

In short:

1. First get the following tools: 7-Zip(Free), WinImage(Demo)
2. Download the ESXi ISO
3. Open the ISO with 7-Zip
4. Extract “install.tgz”
5. Open “install.tgz” with 7-Zip
6. Click on “install.tar”
7. Browse to “usr\lib\vmware\installer\”
8. Open “VMware-VMvisor-big-3.5.0_Update_3-103909.i386.dd.bz2″
9. Extract “VMware-VMvisor-big-3.5.0_Update_3-103909.i386.dd”
10. Open WinImage and go to Disk, click on “Restore Virtual Harddisk Image on physical drive”
11. Select a physical drive
12. Select “VMware-VMvisor-big-3.5.0_Update_3-103909.i386.dd”
13. And click “yes” to write the DD image to the USB Disk