If it isn’t dripping coolant, and you haven’t smelled the coolant on the hot exhaust collector - I’d take a chance on it.
I suspect that a little bit of oil might pass the seal, but it sounds like you just have a trace, and they are not known for failing on that side.
Tackling a perceived oil seal leak, may fail the water pump seal.
Check it regularly to avoid worry.