Use emdebian source list.

Simply add this source list (you might want to change your suite name) :

/etc/apt/sources.list.d/emdebian.list

# 
# -- Emdebian sources.list entries
# 
deb http://www.emdebian.org/debian/ wheezy main

and install gcc-4.4-arm-linux-gnueabi :

$ sudo apt-get update
$ sudo apt-get install gcc-4.4-arm-linux-gnueabi

$ sudo apt-get install gcc-arm-linux-gnueabi

Based on installation script used in linux4tegra 12alpha1

$ echo "Downloading and installing Sourcery G++ Lite."
$ wget http://www.codesourcery.com/sgpp/lite/arm/portal/package4571/public/arm-none-linux-gnueabi/arm-2009q1-203-arm-none-linux-gnueabi-i686-pc-linux-gnu.tar.bz2
$ tar xvjf arm-2009q1-203-arm-none-linux-gnueabi-i686-pc-linux-gnu.tar.bz2

Configure environment

$ export PATH=`pwd`/_out/3rdparty/arm-2009q1/bin:$PATH

Now you are able to use ARCH=arm CROSS_COMPILER=arm-none-linux-gnueabi- to crosscompile sources for arm platform. Also you are able to specify full path in CROSS_COMPILER: for example CROSS_COMPILE=`pwd`/_out/3rdparty/arm-2009q1/bin/arm-none-linux-gnueabi-