I can't think of an easy way how to do this. But you could manually separate the large matrix and indicate that it continues on the next page with \vdots or so. Also you could use \lceil, \lfloor, \rceil and \rfloor as brackets (definitely not ideal, but better than the closed round brackets).
Code: Select all
\documentclass{article}
\begin{document}
$$
\stackrel{
\left\lceil
\begin{array}{ccccccc}
~ & 1 & 2 & 3 & 4 & 5 & 6 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
\end{array}
\right\rceil}
{\vdots}
$$
$$
\stackrel{\vdots}{
\left\lfloor
\begin{array}{ccccccc}
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629\\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629 \\
1 & 0.0741 & 0.0741 & 0 & 0 & 0.0741 & 0.7778 \\
2 & 0.2097 & 0.0806 & 0.0081 & 0.0323 & 0.0403 & 0.629
\end{array}
\right\rfloor}
$$
\end{document}
Note how I use \stackrel{}{} in order to stack the matrix and the \vdots.
This looks something like (second part of the matrix only):

- mat.png (56.95 KiB) Viewed 1958 times
Hope this helps...
Achim
EDIT:
An alternative would be to use the longtable environment. But it is not a math environment and probably wouldn't look as good. But it will do the page break for you.