It sounds like you have the Midi input on your Ableton drum track set to "All Channels".
By default the sequencers output through channels 1 and 2 and the drum track is on channel 10.
Select channel 10 as your input channel in Ableton if you only wan't midi from the drum sequencer.