It is wise to rev the engine just a bit before downshifting.
You cannot just jam it into gear up or down with high rpms.
IT does not have syncros like a car. There are four shifting dogs(pegs) on the side of a gear
Those 4 pegs have to fit into 4 holes on the gear next to it.
Also check to make sure your clutch is working properly.
Trans is probably ok . a beginner mistake.
On a Roadstar Adventure.