Rent a giant hammerdrill with chisel bit. Same thing you would use to bring up tile and grout off the floor. Will make short work of it and will be worth every cent.