I am sure we have all read this in Matt 4: 18-22 many of times, and heard it at church as the Gospel was read:
18 And Jesus, walking by the sea of Galilee, saw two brethren, Simon called Peter, and Andrew his brother, casting a net into the sea: for they were fishers.
19 And he saith unto them, Follow me, and I will make you fishers of men.
20 And they straightway left their nets, and followed him.
21 And going on from thence, he saw other two brethren, James the son of Zebedee, and John his brother, in a ship with Zebedee their father, mending their nets; and he called them.
22 And they immediately left the ship and their father, and followed him.
And after these words were read, I heard the reader comment that when Jesus asked them to follow Him they immediately left everything and followed Him, which it is what the text seems to imply.
Nevertheless, I was stirred in my spirit to further look into this matter, since I had read more to have taken place during this very same time, so I prayed about it seeking guidance, and such was provided as I read Luke 5: 1-11, which I know to have heard and read it many a times:

1 And it came to pass, that, as the people pressed upon him to hear the word of God, he stood by the lake of Gennesaret,
2 and saw two ships standing by the lake: but the fishermen were gone out of them, and were washing their nets.
3 And he entered into one of the ships, which was Simon's, and prayed him that he would thrust out a little from the land. And he sat down, and taught the people out of the ship.
4 Now when he had left speaking, he said unto Simon, Launch out into the deep, and let down your nets for a draught.
5 And Simon answering said unto him, Master, we have toiled all the night, and have taken nothing: nevertheless at thy word I will let down the net.
6 And when they had this done, they inclosed a great multitude of fishes: and their net brake.
7 And they beckoned unto their partners, which were in the other ship, that they should come and help them. And they came, and filled both the ships, so that they began to sink.
8 When Simon Peter saw it, he fell down at Jesus' knees, saying, Depart from me; for I am a sinful man, O Lord.
9 For he was astonished, and all that were with him, at the draught of the fishes which they had taken:
10 and so was also James, and John, the sons of Zebedee, which were partners with Simon. And Jesus said unto Simon, Fear not; from henceforth thou shalt catch men.
11 And when they had brought their ships to land, they forsook all, and followed him.

After much thought and prayer, I am led to believe that these 2 apostles are speaking of the same occurrence, yet, Luke is always giving us more details of the matter, where in Matthew, we are given the main facts.
Now, I know that after our Lord's Resurrection, Peter did return to the fishing trade until the Lord appeared to them on the beach by the fire, yet, I don't recall reading anywhere in the NT that Peter returned to fishing after he started to follow our Lord before His Passion was complete.

Am I looking at his matter correctly? or am I being tempted leading me into confusion?
I pray that clarity may be given to me on this matter through you my brethren in Christ. Amen