< lawmakers shouted over Connor Lamb as he tried to continue with his speech  [It was Not Allred speaking]

< he [Lamb] eventually stopped and looked toward the aisle as lawmakers behind him could be seen leaving the bench and walking over to the reported confrontation. Republicans could also be seen exiting their benches. 

< "There will be order in the House," Speaker Pelosi said, banging her gavel as lawmakers continued to move toward the aisle. "The gentlemen will clear the chamber." The situation then settled down, and Lamb continued with his speech.

The second source indicated-- 

< Pelosi was asked by a Republican [Morgan Griffith] to have Lamb's words taken down [i.e. eliminated from transcripts]

< Andy Harris (R- Md.) stood up and yelled "take the words down."

 <A Democratic told Harris to "sit down,"... Harris yelled: "You sit down!"  

< Rep. Al Lawson (D-Fla.) stood up and begin walking toward Harris, who in turn stepped into the chamber's center aisle toward the oncoming Lawson. 

< Rep. Colin Allred (D-Texas), a former professional football player, was seated on the aisle, . .  stood, turned to Harris and said, "Are you serious?"

Other lawmakers and aides rushed over to separate the pair as they approached one another. This ended the encounter.   

Other Republicans, in addition to Harris, were objecting to Connor Lamb's comments.  Harris was not alone in his strong views. 

Again, Allred was not in the process of giving a speech-- It was Connor Lamb. And I saw no reports saying Harris was ejected.  Also there's many differences and conflicting information of how the participants moved about, compared to your narrative.   

Yes there was angry shouting, between the two sides.  Imagine that, disagreements in Congress.