"So on and so forth" may seem weird, but it's definitely an english idiom. Especially idiomatic stuff can sound really strange, but I guess that's due to a common origin.

"Don't look a gift horse in the mouth" still sounds absolutely stupid to me.