No, you can't refuse to become a jedi. It would make no sense for the jedi council to allow you refuse proper jedi training... let's just say they know a bit more about you then you know yourself
As for the black crystal... it doesn't exist (confirmed on the bioware boards).