Pick over the lobster meat if necessary, and chop it up.
In a large mixing bowl, sift together the flour, salt, cayenne pepper and baking powder.
In another bowl, blend together the egg and milk, stir in the lobster meat. Add this to the flour mixture and mix well.
Heat the peanut oil in a large skillet until hot but not smoking, or in an electric fryer set at 365 degrees. Drop the lobster mixture by rounded tablespoonfuls into the hot oil, fry 3 minutes or until golden. Don't crowd the pan. Drain on paper towels and keep warm until all are done. Serve piping hot as an appetizer or a first course with tartar sauce.