The gene expression classification is the most important study in cancer diagnosis and drug discovery. Nevertheless, this task is very complicated to achieve accurate results because datasets have a very large number of dimensions and very few datapoints. In this paper, we propose the new ensemble learning algorithms with support vector machines (SVM) for efficiently handling the gene expression classification task. The Sherman-Morrison-Woodbury formula is used in the Newton SVM (NSVM) algorithm proposed by Mangasarian to make an extension of Newton SVM for dealing with datasets having a very large number of dimensions. Followed which, the ensemble learning trains the new extended Newton SVM for classifying gene expression datasets with simultaneously large number of datapoints and dimensions. The numerical test results on high-dimensional gene expression datasets show that our ensemble learning algorithms of Newton SVM are significantly faster and/or more accurate than the highly efficient standard SVM algorithm LibSVM.