[Bug] [seatunnel-engine] Concurrent task execution

[Xuzhengz]

Search before asking

• I had searched in the issues and found no similar issues.

What happened

After submitting 20-30 tasks simultaneously using rest API, the engine crashes and only a few tasks succeed.

SeaTunnel Version

2.3.8

SeaTunnel Config

{
    "env": {
        "job.mode": "batch"
    },
    "source": [
        {
            "plugin_name": "FakeSource",
            "plugin_output": "fake",
            "row.num": 1000000,
            "schema": {
                "fields": {
                    "name": "string",
                    "age": "int",
                    "card": "int"
                }
            }
        }
    ],
    "transform": [
    ],
    "sink": [
        {
            "plugin_name": "Console",
            "plugin_input": ["fake"]
        }
    ]
}

Running Command

rest-api

Error Exception

please see log screen

Zeta or Flink or Spark Version

2.3.8

Java or Scala Version

1.8

Screenshots

master：

worker：

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[Xuzhengz]

please see

[Xuzhengz]

Please note that the logs should be viewed from 10:10 am on the 12th to 20th, when 20 tasks are submitted concurrently

[Xuzhengz]

seatunnel-engine-master.log
seatunnel-engine-worker1.log
seatunnel-engine-worker2.log