Some will hate it while some will like it. Basically to me, its your work and you do not need to justify to anybody why you did it unless the photo was for a client. Image manipulation is a good way to create images which are impossible / near impossible to shoot. An example is the image attached where I decided to merge an old moon photo with a model plane photo.
So go out there and go crazy manipulating your images :)