I figured H. Rider Haggard went by H. because his first name was boring (it was Henry, as one might have guessed). Though why he didn't just drop it (as Rudyard Kipling dropped his initial Joseph) I do not know.