The problem was due to the directory permissions on /downloader (was 775, needed to be 755 and the /downloader/index.php (was 755 needed to be 644).
Also, the magento php.ini changes needed to be added to a custom php.ini in the main directory and /downloader.