Number of documents effect the performance in system?

In live system, we have around 3.5 million documents stored in knowledge centres.

Will this effect the performance in System?

If we those documents to any FTP server, will performance of system increases ?

  Discussion posts and replies are publicly visible

Parents
  • As long as system resources are scaled appropriately and good design patterns are followed, I don't consider it problematic to have that many documents. Appian is designed to support that volume of usage, and I'm aware of several customers who have a similar (or greater) number of documents. (One scalability pattern that may be particularly worth considering is having an HA configuration, since this will allow for improved concurrency and throughput, with multiple nodes available to service read calls.)

    As you can imagine, the greatest strain on the system would be anywhere that you're asking the system to consider all 3.5 million documents at once. For example, if you had them all in a single KC and then opened that KC; accessing the All Objects view in Appian Designer without any type filters applied to filter out documents (since documents are, of course, Appian objects); or having a document picker that had the ability to suggest any of the 3.5 million documents. Of course, we continue to work to make these cases even faster too.

    In my experience, it's uncommon for there to be a use case where all 3.5 million documents are relevant to a single user. In practice, individual users may need to interact with a smaller subset of specific documents, and the fact that there happen to be that many total documents on the system doesn't affect the users.

    In terms of storing them externally (such as on an FTP server as you describe), that could be still be a good idea, but it depends on the specifics of your use case. It may make certain design patterns more complicated to implement, and it could make certain user interactions slower. Generally, it's going to be faster for the user to communicate directly with the server where documents are stored than it is to communicate with a server that's acting as an intermediary for the external server where the documents are stored. Though, by the same token, it may make it easier to design for the rest of your use cases if you've isolated your document-based use cases to a single part of your architecture.
  • The number of documents increase day by day, will it impact search server. It is nightmare if i want to search for any object in Live. I have seen in the documentation "The search server's use of disk and memory resources will scale with the amount of design objects, user activity, and rule executions".
    docs.appian.com/.../Search_Server.html
Reply Children