Technically, math started circa 1890BC in ancient Egypt.
Science can trace its roots back as well to ancient Egypt and Mesopotamia 2000-1000BC, which then went to ancient greece, wherein astronomy and mathematical sciences evolved.
It gets hard to quantify science as a whole due to how many facits there are, however the indus river valley civilization was quite innovative. They had a river, and made a whole draining and farming system, which could be said to have kicked off civilization as a whole.