Archive for the ‘Debian’ Category

New GNU/kFreeBSD build daemon

Tuesday, July 31st, 2007

We now have a second GNU/kFreeBSD build daemon building the kfreebsd-amd64 architecture. It has been kindly offered and is hosted in UK by The Positive Internet Company Ltd.

It adds redundancy to our buildd network, which is important given that the other kfreebsd-amd64 build daemon machine is on a simple ADSL line, and so less reliable than a machine in a datacenter.

For those who want to know more, here is the current status of the GNU/kFreeBSD buildd network:

  • callisto.debian.net (kfreebsd-amd64)
    2 x Opteron 1.4GHZ, 1GB RAM
    Hosted by The Positive Internet Company
  • shockley.aurel32.net (kfreebsd-amd64)
    Sempron 2600+, 1GB RAM
    Hosted by Aurelien Jarno (ADSL)
  • hagrid.debian.net (kfreebsd-i386)
    PIII 800 MHz, 512MB RAM
    Hosted by ETH Zürich
  • maxwell.aurel32.net (kfreebsd-i386)
    Sempron 2600+, 1GB RAM
    Hosted by Aurelien Jarno (ADSL)

My goal is to eventually get rid of all build daemons that I am hosting at home on my ADSL line, though that is less critical now.

94.4%

Sunday, February 25th, 2007

Christian, this is the percentage of your blog entries concerning translation ratios in the last two weeks.

I am sure you can do better ;-)

New ARM autobuilders

Sunday, December 17th, 2006

I am really upset by the way the ARM build daemons are managed. The packages are not uploaded regularly, with sometimes three days between two uploads. Well it should not be a problem, if packages that have failed to build due to some packages not uploaded fast enough (see for example python-gnome, or rkward) were requeued, but that’s actually not the case. Also last week, the build daemon named “cats” stopped to upload packages, despite it continued to build them. 11 days later, nothing has changed even after a mail to arm@buildd.debian.org. And I do not speak about build daemons building nothing.

All of that resulted in ARM being the slowest architecture to build packages. It looks like the ARM build daemon maintainer does not know the excellent page made by Jeroen.

As arm@buildd.debian.org is everything but responsive (well if you can assign a level of responsiveness to /dev/null), I have decided to act. I have installed QEMU on an 8-way Opteron machine, and created 8 emulated ARM machines, which 256MB of RAM and 10GB of disk for each, all running buildd + sbuild. Altogether those 8 emulated ARM machines should be faster than all the Debian ARM build daemons. I have setup a wanna-build database on my server. During the day it has built around 100 packages.

Yes I agree that real machines would be better, but I don’t have a stack of fast ARM machines at home. Anyway when you see random segfaults on the build daemons, or strange failures (that happen for weeks) on the build daemon named “netwinder“, you may think to that again.

Unfortunately the machine I use for that is only available for a few months, and I will have to stop the emulated machine then. I just hope that the situation with respect to the build daemons will improve, so that I can stop them even before.

NEW queue almost empty

Sunday, November 19th, 2006

The NEW queue is almost empty with 7 packages only. Thanks a lot Joerg.

Cheap MIPS/MIPSEL development machine

Monday, November 13th, 2006

In addition to the ARM platform, it is now possible to emulate a MIPS (big endian) or MIPSEL (little endian) machine running Debian under QEMU. It could be used as a cheap MIPS/MIPSEL development machine to test your packages, provided that you have a not to slow i386, AMD64 or PowerPC computer.

Running on an Athlon 64 X2 3800+ the emulated system is around 10% faster than my SGI Indy R4400SC 200MHz and possibly with much more RAM (my emulated system has 512 MB of RAM). Also for the ones who know about the Indy SCSI controller, the transfer rate is around 13 MB/s on the emulated system.

I have written a small howto explaining how to install Debian Etch on such an emulated MIPS or MIPSEL machine, using Debian-Installer RC1, which has just been released.

Thanks to Daniel Jacobowitz who has recently improved QEMU/MIPS a lot, and to Thiemo Seufer who has started the integration of the MIPS QEMU platform in Debian-Installer and in the Debian kernel.

Note 1: I have written this howto very quickly, so there are probably some mistakes. Comments are welcome.
Note 2: I have updated the ARM howto to take in account improvements from Debian-Installer RC1

Experimental is not autobuilt (at least for glibc)

Saturday, November 11th, 2006

Martin, I can’t let you say that experimental is autobuilt. I have uploaded a few versions of the glibc to experimental in the last few months and only arm, hppa and alpha have tried to build them. Before the summer mips and mipsel also have tried to build the experimental glibc. And the last version has not been tried on alpha, despite the fact it includes a fix and should now build correctly on this architecture.

Hopefully I have most Debian architectures at home, but alpha, m68k and ia64, so I can build the glibc on my own machines. For m68k and ia64, I can use debian.org machines. Concerning alpha, the debian porting machine, ie escher.debian.org, is locked down since the compromise about 4 months ago. And no answer to my mail to debian-admin… Hopefully a user kindly gave me an access on his machine, thanks. The glibc 2.5 is now building correctly on this machine, but I can’t upload the package because I can’t trust the machine. That really sucks.

What about removing alpha from the release architectures? After all, it fails to comply with the etch candidate release architecture criteria for months.

Update: Some build daemons had glibc in “weak-no-autobuild”. Thanks Martin for fixing that.

Cheap ARM development machine

Monday, September 25th, 2006

You want a cheap ARM development machine to test your packages? You can actually have one for free (both as in beer and as in speach :) ) provided that you have a not to slow i386, AMD64 or PowerPC computer. The solution is called QEMU, a generic and open source processor emulator which can emulate i386, x86_64, ARM, MIPS, PowerPC and Sparc systems.

Running an Athlon 64 3800+ the emulated system is around 20% faster than the popular NSLU2 and possibly with much more RAM (my emulated system has 256 MB of RAM).

I have written a small howto explaining how to install Debian Etch on such an emulated ARM machine.

Note: I have written this howto very quickly, so there are probably some mistakes. Comments are welcome.

How Ubuntu is slowing down Debian

Wednesday, July 19th, 2006

Today in bug report #369411:

“I do oppose an NMU as you haven’t actually explained why this patch is
necessary. Ubuntu doesn’t have this patch and yet has been building
32-bit alsa for several releases without problems.”

While Ubuntu has this patch included for 3 weeks now. I have written this patch to fix an RC bug in Debian…

FOSDEM slides up

Monday, March 20th, 2006

I gave a talk about Debian GNU/kFreeBSD at FOSDEM 2006. It tooks me time, but I finally have made the slides available.

kfreebsd-amd64 build daemon

Sunday, March 5th, 2006

Yesterday I have setup a kfreebsd-amd64 (ie GNU/kFreeBSD on an amd64 CPU) build daemon. Its name is shockley.aurel32.net (all my machines are named related to electronics), and it has Sempron 2600+ CPU.

As you can see on the photo, it is still missing a decent case. There are actually two machines on the the photo, the motherboard in the case is maxwell’s one (one of the kfreebsd-i386 build daemon), while the one on the top front is shockley’s one. That’s a bit strange, but the amd64 motherboard needs a power supply with a P4 connector, while the other one only needs a small power supply.

Thanks to Ingo Juergensmann, the kfreebsd-amd64 architecture is now listed on http://buildd.net. As you can see on the graph, this machine is very fast (it only runs for 24 hours!).

GNU/kFreeBSD build daemons : maxwell (i386) and shockley (amd64)

GNU/kFreeBSD on http://buildd.net

Saturday, September 17th, 2005

Thanks to Ingo Juergensmann, the kfreebsd-i386 architecture is now listed on http://buildd.net. That means that Debian developers can now easily check the state of their packages, and if they fail to build, to find why.

The requirement to appear on http://buildd.net was to use wanna-build and make its output available somewhere on the web. As I was still using a set of (very) ugly shells scripts to handle the build-daemon, I spent a part of the last days to setup wanna-build, and to understand how it works. With wanna-build a lot of thing is automatic, and almost everything could be controled via the mail interface. That would save me some time that I could invest in porting packages to GNU/kFreeBSD.

Debian GNU/kFreeBSD developer accessible machine

Saturday, August 6th, 2005

The machine on the photo below is currently somewhere between France and Switzerland. It runs Debian GNU/kFreeBSD, and will be accessible to all Debian developers. Thanks to Gürkan Sengün, the ETH Zürich will host it.

io.debian.net

Debian GNU/kFreeBSD build daemon upgraded

Sunday, July 24th, 2005

I am running a build daemon for the Debian GNU/kFreeBSD port. It was a bit overloaded by the high number of packages to build since the CXX ABI transition has begun. I decided to use the old mainboard of my main computer to upgrade it from an AMD K6-2 500 to an Athlon XP 1800+. I also had to buy a new box since the old mainboard was an AT one, whereas this mainboard is an ATX one. The hard disks (an old 8.4 GB IDE disk for the system and an old 4.3 GB SCSI disk for the build daemon stuff) are still a bit slow, that is probably the next thing I’ll upgrade.

It runs for a few hours now and has already reduced the backlog. Currently 83% of the Debian packages are built for the kfreebsd-i386 architecture.

Is Debian still the universal OS?

Tuesday, March 15th, 2005

As others I am very unhappy with the outcome of the release meeting. This “proposal” has been made by people that have key responsabilities in Debian, and without asking other people, except the DPL candidates. By the way, I feel silly that such persons sign this “proposal” as DPL candidates, whatever is their opinion.

In short the proposal says: “We’ve got problems to release with 11 architectures, let’s drop 8 of them.” A lot of users who choose Debian because it was the only distribution out of there to provide serious support for the architectures they care for, for various reasons. That’s the end of the Universal OS, and that’s sad.

It’s seems that the actual teams found they are overloaded, so as they don’t want to share their powers and call for help (even worse, they refuse help), they prefer to drop architectures.

The criteria given to keep architectures seems to have been choosen after the list of architectures itself. And actually none of the architectures in Debian fulfill them (all the four proposed architectures, i.e. i386, ppc, amd64 and ia64, only have one build daemon). And when you ask the technical point behind each criterion, nobody answers…

I don’t say there isn’t any problems, but there is a difference between a reasonable answer to these problems, and dropping most of architectures we support. If they are problems with build daemons, the solution is to solve them (hint: more build daemons and more admins would be a good start).

But actually I doubt the number of architectures is the real problem for Sarge. One of the main problems since August (at least that is what is announced in every “Bits from the release manager”), is the testing build daemons. Why it lasts so long? Why offers for help have been refused?

And don’t forget the social contract: “Our priorities are our users and free software”

simulpic: new upstream version for more than 8 years!

Friday, January 28th, 2005

I have just uploaded a new version of simulpic. This software is a simulator for Microchip PIC16F84 microcontrollers. The initial version was a student project of the University of Pisa, and the development has stopped 8 years ago. Well, not really stopped as they were some patches in the Debian package.

Recently, a new upstream has decided to continue this project and to add some functionalities. He has just released a new version, the first one for more than 8 years! That demonstrates the power of Free Software.

Do some kind of greylisting on Debian bugs?

Tuesday, January 11th, 2005

Over the last few months, it seems that the number of silly bugs is increasing. Of course, in most of the cases, the severity of such silly bugs is set to critical. I won’t list all that silly bugs (it would take too long :) ), but I’ll take two examples, that are very recent as they occured today yesterday.

The first one is the bug #289666 titled “sane only work as root on 2.6.10 (2.6.*)”. The bug reporter explains that the module scanner.o has been removed from the kernel and thus he, and all other users, should use the root account to scan a document. He think it is a critical security bug. I don’t know why Julien Blache wrote a README to explain how to be able to scan as user! The command is very simple: adduser user scanner.

The second annoying bug was filled today on OpenOffice.org. It is bug #289800 and is titled “openoffice.org: please enable autosave per default”. Basically, the user was writting a text on OpenOffice.org, and its machine crashed. As he hasn’t saved the document, and as autosave was not enabled, he lost it. Surely not a critical bug. Maybe the user should learn all to click on the save icon instead of sending bug reports!

Maybe we should do something to avoid these annoying bugs. A kind of greylisting, which first sends back an email to the bug reporters (asking them if they have read the documentation, if they have verified that the bug has not been already reported, if they are using the latest version) and then that waits for a key contained in the email to be returned to validate the bug. This could also avoid people using invalid email addresses.

Yes, such a system looks like a bit silly… just as some of the bug reporters.

Back on the Internet

Tuesday, November 30th, 2004

My ADSL line was opened yesterday, so I am back on the Internet! Actually during the last two months, I still had an Internet connection, but only though a 56k modem, not really useable for maintaining Debian packages or for doing an “apt-get upgrade” on my machines (and a bit costly).

I am in my apartment for a month, and it tooks two weeks to get the invoice of my telephone line, one more week to get the ADSL line and one more week to get my modem from the post.

The connection is an ADSL2+ connection, so there is enough upload rate to be able to host websites. I moved all my websites to my home server, and I am just waiting the activation of the reverse DNS to be able to host an SMTP server.

My new apartment

Wednesday, November 3rd, 2004

Yesterday I moved to my new apartement. Moving was not really easy as it was running cats and dogs. The apartement now looks a bit empty, as I currently only have a camping mattress, a sleeping bad, a few clothing, without forgetting my computers… I need to buy a mattress, a fridge, solid plates, etc.

In the next few days, I’ll have to open a telephone line, with an ADSL connection. I hope it wouldn’t take too much time, as it’s not very easy to only have an Internet access at work. That’s why I am not so active into Debian by now, though I am still reading my mails and uploading packages.

Switching to kernel 2.6 (part 2)

Tuesday, September 28th, 2004

Yesterday I switched all of my machines but one to kernel 2.6. The last one to migrate is a SparcStation 4. It is a little bit complicated as the BIOS refuse to recognize my hard-drive since I changed it from a 2.1GB one to a 9.1GB. After an afternoon of tests, I decided to boot this workstation via the network, as the Linux kernel recognizes it.

Using a 2.4 kernel was very easy, you just have to convert the Debian kernel in aout format using zcat and elftoaout. For a 2.6 kernel, it is a little more complicated as Debian ships them with an initrd image. After a few minutes searching google, I found the solution:


zcat /boot/vmlinuz > vmlinux
elftoaout -o netboot.img vmlinux
piggyback netboot.img /boot/System.map /boot/initrd.img

It seems to work well, however the image is 271,654,944 bytes long. I still don’t understand why.

Switching to kernel 2.6

Tuesday, September 28th, 2004

I decided to switch all my machines to kernel 2.6. I now consider the kernel 2.6 stable enough, at least for the use of my machines. Except for my workstation on which I like to add some patches, I am using Debian kernels for my other machines. Moreover some of them are very slow (a parisc@60 MHz and a sparc@110 MHz), and building a kernel on such machines takes very long time.

I started with my a backup server, it was very easy, apt-get install and voilà!

Then I switched my firewall. It was not so easy as for my backup server, as I only have a 256 MB disk (actually a compact flash card). Because of its size, it was not possible to have two kernels at the same time on the disk. I decided to remove the old 2.4 kernel (/boot and /lib/modules), to install the new 2.6 kernel. Then I typed reboot, and started to pray. As I don’t have neither a display nor a keyboard on that machine, I started to look both at the hard disk’s LED and at a console on my workstation on which I started ping fourier. After a some time (I don’t know exactly how much, in such situations seconds are like minutes), there was some echo reply. Wonderful!

After such successes, I decided to continue and to switch my hppa machine. Again apt-get, then a quick look at the palo’s documentation to know how to specify an initrd image, and then reboot. After a lot of time, it was still not possible to ping the machine. Shit! PALO has the possibilty to specify an alternate kernel in case of a problem, however in that case it seems it has failed… or the boot was mabe successfull. Half an hour later, after I plugged a screen, a keyboard and a null-modem serial cable, I understood the problem: the module for the network card was not loaded (whereas it was directly binded into the 2.4 kernel). And hotplug doesn’t load it as it is not on a PCI bus. I tooked my keyboard and started to write my login. Nothing. The keyboard’s module was also not loaded. I switched back to the 2.4 kernel, I put a lot of modules into /etc/modules (network card, keyboard, mouse, sound card, parallel port, serial port, etc.). And it worked!

Moral: Don’t change your kernel when you only have very few time to do that. It always take a lot longer than expected.