How do I create an empty array/matrix in NumPy?
I can't figure out how to use an array or matrix in the way that I would normally use a list. I want to create an empty array (or matrix) and then add one column (or row) to it at a time.
At the moment the only way I can find to do this is like:
mat = None for col in columns: if mat is None: mat = col else: mat = hstack((mat, col))
Whereas if it were a list, I'd do something like this:
list =  for item in data: list.append(item)
Is there a way to use that kind of notation for NumPy arrays or matrices?
You have the wrong mental model for using NumPy efficiently. NumPy arrays are stored in contiguous blocks of memory. If you want to add rows or columns to an existing array, the entire array needs to be copied to a new block of memory, creating gaps for the new elements to be stored. This is very inefficient if done repeatedly to build an array.
In the case of adding rows, your best bet is to create an array that is as big as your data set will eventually be, and then add data to it row-by-row:
>>> import numpy >>> a = numpy.zeros(shape=(5,2)) >>> a array([[ 0., 0.], [ 0., 0.], [ 0., 0.], [ 0., 0.], [ 0., 0.]]) >>> a = [1,2] >>> a = [2,3] >>> a array([[ 1., 2.], [ 2., 3.], [ 0., 0.], [ 0., 0.], [ 0., 0.]])
Read more... Read less...
A NumPy array is a very different data structure from a list and is designed to be used in different ways. Your use of
hstack is potentially very inefficient... every time you call it, all the data in the existing array is copied into a new one. (The
append function will have the same issue.) If you want to build up your matrix one column at a time, you might be best off to keep it in a list until it is finished, and only then convert it into an array.
mylist =  for item in data: mylist.append(item) mat = numpy.array(mylist)
item can be a list, an array or any iterable, as long
item has the same number of elements.
In this particular case (
data is some iterable holding the matrix columns) you can simply use
mat = numpy.array(data)
(Also note that using
list as a variable name is probably not good practice since it masks the built-in type by that name, which can lead to bugs.)
If for some reason you really do want to create an empty array, you can just use
numpy.array(), but this is rarely useful!
To create an empty multidimensional array in NumPy (e.g. a 2D array
m*n to store your matrix), in case you don't know
m how many rows you will append and don't care about the computational cost Stephen Simmons mentioned (namely re-buildinging the array at each append), you can squeeze to 0 the dimension to which you want to append to:
X = np.empty(shape=[0, n]).
This way you can use for example (here
m = 5 which we assume we didn't know when creating the empty matrix, and
n = 2):
import numpy as np n = 2 X = np.empty(shape=[0, n]) for i in range(5): for j in range(2): X = np.append(X, [[i, j]], axis=0) print X
which will give you:
[[ 0. 0.] [ 0. 1.] [ 1. 0.] [ 1. 1.] [ 2. 0.] [ 2. 1.] [ 3. 0.] [ 3. 1.] [ 4. 0.] [ 4. 1.]]
I looked into this a lot because I needed to use a numpy.array as a set in one of my school projects and I needed to be initialized empty... I didn't found any relevant answer here on Stack Overflow, so I started doodling something.
# Initialize your variable as an empty list first In : x= # and now cast it as a numpy ndarray In : x=np.array(x)
The result will be:
In : x Out: array(, dtype=float64)
Therefore you can directly initialize an np array as follows:
In : x= np.array(, dtype=np.float64)
I hope this helps.
You can use the append function. For rows:
>>> from numpy import * >>> a = array([10,20,30]) >>> append(a, [[1,2,3]], axis=0) array([[10, 20, 30], [1, 2, 3]])
>>> append(a, [,], axis=1) array([[10, 20, 30, 15], [1, 2, 3, 15]])
Of course, as mentioned in other answers, unless you're doing some processing (ex. inversion) on the matrix/array EVERY time you append something to it, I would just create a list, append to it then convert it to an array.
Here is some workaround to make numpys look more like Lists
np_arr = np.array() np_arr = np.append(np_arr , 2) np_arr = np.append(np_arr , 24) print(np_arr)
OUTPUT: array([ 2., 24.])