Hi everybody, We are looking for advices/best practices prior to deve

Hi everybody,

We are looking for advices/best practices prior to develop an application around data manipulation. Among the requirements, we need to:

- create a table from an excel file
- improve data quality using matching alogrithm
- display the matching result and get approvals from users

The expected number of input rows is around 10k+ but the number of distinct "matching" is more about a couple of hundreds I suppose.

For now, we have been thinking at the following solutions :

1- To create the table : use the excel file plugin + create CDTs + use write to data store entity Smart Service
2- To perform the matching, we have a custom expression that works just fine
3- To display distinct matchings: use the Query Database Smart service (SELECT DISTINCT... ) + create CDTs + use of paging grids for display

We encounter some limitations for 1&3 (nodes limit (1000), number of max rows returned by a query (10), latency) and prior to move on custom...

OriginalPostID-57770

OriginalPostID-57770

  Discussion posts and replies are publicly visible

Parents
  • 0
    Certified Lead Developer
    Is there a reason why you are not using the database itself to do the number crunching. Stored procedures are definitely the way to go.

    The performance would far exceed anything you could write in process or custom plugins.

    Appian's strength lie in the presentation and sharing of data, not high load manipulation.
Reply
  • 0
    Certified Lead Developer
    Is there a reason why you are not using the database itself to do the number crunching. Stored procedures are definitely the way to go.

    The performance would far exceed anything you could write in process or custom plugins.

    Appian's strength lie in the presentation and sharing of data, not high load manipulation.
Children
No Data