0

Risk of performance of projects given number of tasks

Electronic Arts

November 20, 2018 10:01

None

Follow

Hi,

We are about to move a huge project that will be active for years and that will contain a large number of tasks over time.

In the last 3 years, in our old tool we submitted about 9000 documents to the project, each to be translated to 15 languages.

In Wordbee the minimum workflow we can establish is 2 jobs per language, so we forecast about 270,000 jobs in the next three years.

In order to contemplate an archiving strategy, can you let us know if this large number of jobs can impact the project in any way?

Thank you very much.

• Facebook
• Twitter
• LinkedIn

2 comments

• 
  Stephan Böhmig November 20, 2018 10:42 Official comment

  Hi,

  A is no technical issue with having so many jobs in a single project. When filtering jobs in the project, response times will of course be slower and this is why a good archiving strategy is indeed recommended. Let me summarize 3 approaches to handle huge amounts of data:

  (1)

  Once per month, go to the project and then the jobs page. Filter all completed jobs older than xx months. Click the Manage button and choose the deletion option. This removes the jobs from the system while maintaining the documents and segments.

  (2)

  When pushing files into the project, create root directories with the year or year-month. For example, files of October 2019 would go into /2019-10/*

  Then once a month you right click folders older than xx months/years and you choose "Mark for no translation". This removes the files, segments and jobs for the selected month. If you are consolidating translations into master memories, you do not lose your translations. You can also zip the folders in the file explorer and download the files or use the API to do so.

  (3)

  Use of Beebox. This product was designed to handle a large amount of files and more importantly allows to create jobs that consolidate content from multiple files into single jobs. Instead of creating 200.000 workflows you can easily reduce to a small amount depending on the size of the ffiles.

  For example, if you have 1000 files with 50 segments each (thus 1000 workflows with 50 segments each), then you can consolidate this into 100 workflows with 500 segments each.

  Beebox is a software you can install to your server. It links into your Wordbee project to send jobs and retrieve back translations when done. It then delivers the thousands of final files to a hot folder. Beebox also has an API to better automate the process.

  Kind regards,

  Stephan

• 0
  
  Electronic Arts November 20, 2018 13:56

  Hi Stephan,

  Thanks a lot for the insight!

  Best regards.